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(57) Video signal transmitting system in which digital 
video signal are divided into groups of predetermined 
frames. Digital video signals of at I east one frame of them 
are intraframe coded and then transmitted. Remaining 
digital video signals are interframe coded with reference 
to the digital video signals, intraframe coded, and the dig- 
ital video signals, intraframe coded, of a subsequent 
group of frames and are then transmitted. A motion vec- 
tor from a predetermined reference frame is-detected._ 
Video signals are interframe coded by the motion vector 
to transmit the video signals. A motion vector from a 
frame which is frames away from the reference frame is 
converted to motion vector per one frame between the 
reference frame and the frame, is optimized, and is then 
transmitted. 
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Description 

The present invention relates to a video signal transmitting system, and is suitably applied to a case where moving 
picture signals are transmitted. 

5 In the so-called video transmitting system, such as television conference system and television telephone system, 
video signals representing moving pictures are conventionally sent to a remote destination. The transmission efficiency 
of significant information is enhanced by efficiently using a transmission capacity of tiie transmission channel. 

For this purpose, the transmitting unit does not send all the sequential frame pictures but performs the so-called 
frame dropping processing of the frame pictures such as to remove predetermined frames and then transmits the video 

10 signals. 

In the receiving unit, motion vectors are received from the transmitting unit in place of the video signals of the frames 
removed, and tiie original video signals are reconstructed by interpolating tiie frame pictures, which have undergone 
the frame dropping processing, by using the motion vectors with reference to information of frame pictures before and 
after them, the motion vectors being transmitted from tiie transmitting unit in place of the video signals of the frames 
15 dropped (Patent Laid-open Publication No. 60 (1985)-28392). 

According to tiiis technique, it is theoretically sufficient to transmit information of motion vectors in place of information 
of frame pictures which have been dropped, the former being smaller in amount than the latter. Thus, it is considered 
that the technique efficientiy sends significant information of the video signals. 

Accordingly, the more frames are dropped, the more efficiently video signals are ti^ansmitted. 
20 When video signals are practically undergone high efficiency coding processing and then recorded on a recording 
medium, such as a compact disc, errors cannot be however prevented from taking place, i^oreover. video signals are 
reversely reproduced and random accessed and hence when a large amount of frames are dropped, it is difficult to 
reproduce video signals with high quality. 

EP-A1 -0,289,960 describes an apparatus for reducing the amount of data required to be stored when recording a 
25 video image. This document discloses a metiiod of processing image data provided in frames by splitting tiie image 
sequence into groups of frames. The first frame of each of these groups is intra-frame processed, witii the subsequent 
frames being inter-frame processed based upon the preceding frame. When the end of the group is reached, the first 
frame of the successive group is inter-frame processed based upon the last frame of the group. This provides data 
compression whilst still allowing reverse playback. 
30 DE-A1 -3.809,443 describes a similar apparatus to tiie above which carries out intra-frame coding on an initial frame 
and then inter-frame coding on subsequent frames based upon tiie proceeding frame, as long as tiie amount of change 
between the two images is not too large. If so tiie apparatus returns to intra-frame coding for tiie next frame, at least. 

In view of tiie foregoing, an object of this invention is to provide a video signal transmission system which is capable 
of transmitting efficientiy high quality video signals. 
35 According to tiie present invention there is provided an encoding metiiod as claimed in claim 1 of the attached claims 
and a corresponding decoding method as claimed in claim 2. Furtiiermore. according to the present invention tiiere is 
provided encoding and decoding apparatus as claimed in claims 3 and 4 respectively. 

The nature, principle and utility of tiie invention will become more apparent from the following detailed description 
when read in conjunction with the accompanying drawings in which like parts are designated by like reference numerals 
40 or characters. 

In tiie accompanying drawings: 

FIGS.-1 is a diagramniatic viw illustrating a video signal transmitting system according to one embodiment of tfi^ 

present invention; 

45 FIG. 2 is a diagrammatic view showing the operation of the video signal transmitting system; 

FIG. 3 is a block diagram showing the overall construction of the transmitting unit; 

FiG. 4 is a block diagram showing a reordering circuit; 

FIG. 5 is a diagrammatic view showing the operation of the reordering circuit; 

FIGS. 6(1) and 6(2) are block diagrams of the motion vector detecting circuit; 
50 FIGS. 7(1) and 7(2) are diagrammatic view showing the operation of the motion vector detecting circuit; 

FIG. 8 is a diagrammatic view illustrating frame data; 

FIG. 9 is a characteristic graph showing priority detection of the motion vector; 

FIG. 10 is a block diagram showing the adaptive prediction circuit; 

FIG. 1 1 is a diagrammatic view showing the operation of tiie adaptive prediction circuit; 
55 FIG. 1 2 is a graph of a characteristic curve illustrating the priority selection of the infraf rame coding processing and 

the interframe coding processing; 

FIG. 13 is a diagrammatic view showing transmission frame data; 

FIGS. 14-16 are diagrammatic views illustrating headers of the frame data; 

FIG. 1 7 is a block diagram showing receiving unit; 
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FIG. 18 is a diagrammatic view showing the normal mode operation; 

FIG. 19 is a diagrammatic view showing the reverse mode operation; 

FIG. 20 is a block diagram showing the adaptive prediction circuit; 

FIG. 21 is a diagrammatic view showing another embodiment; 
5 FIG. 22 is a block diagram illustrating the adaptive prediction circuit of tiie another embodiment; 

FIG. 23 is a diagrammatic view showing the operation of the adaptive prediction circuit; 

FIG. 24 is a diagrammatic view showing the modified form of the adaptive prediction circuit; 

FIGS. 25 and 26 are diagrammatic views showing the principle of detection of the motion vector; 

FIG. 27 is a block diagram showing the run-length-Huffman encoding circuit; 
10 FIGS. 28 and 29 are diagrammatic views showing the encoding processing of motion vectors; 

FIGS. 30 and 31 are diagrammatic views illustrating the read only menf>ory circuit; 

FIGS. 32 and 33 are diagrammatic views showing data of the encoded oration vectors; and 

FIGS. 34 and 35 are diagrammatic views illustrating the problem. 

15 Preferred emtxxliments of this invention will be described with reference to the accompanying drawings. 

(1) Principle of Video Signal Transmission 

When a video signal coding metiiod according to present invention is applied to a video signal transmitting system. 
20 video signals are transmitted according to the technique as shown in FIG. 1 . 

More specifically, the transmitting unit divides video signals of frame data FO. F1, F2. F3 ... into predetermined 
groups of frames and sequentially processes them (FIG. 1(A)). 

In this embodiment, the transmitting unit divides frame data FO, F1 , F2, F3 ... into groups of frames each including 
a unit of six frames, and the leading frame data FO. F6 of each group of frames are infraf rame coded and then transmitted. 
25 The intraf rame coding processing refers to a processing in which a compression processing is performed on pictures 
in such a manner that the difference between pixel data is obtained, the pixel data being one- or two-dimensionally 
adjacent to each other along the scanning direction, for example. With tiiis processing, transmission frame data having 
each picture compressed in the amount of data are constructed. 

Thus, in tiie receiving unit, frame data for one frame can be reconstructed by sequentially adding transmission frame 
30 data, intraframe coded, for one frame. 

In the transmitting unit, frame data F1 . F2, F3 ... except the leading frame data FO, F6 of each group of frames are 
inlerframe coded and then transmitted. 

The interframe coding refers to a processing in which after a motion vector is detected between frame data of a 
predicted frame, which serves as a reference, and frame data to be coded, frame data (hereinafter refen-ed to as predicted 
35 result frame data) are produced by shifting the frame data of the predicted frame by amount of the motion vector. The 
difference in data between the predicted result frame data and frame data to be coded is coded together witii the motion 
vector to produce transmission frame data. 

Thus, in the transmitting unit, with respect to each of frame data F1 . F2. F3 ... except tfne leading frame data FO, F6 
of each group of frames, a motion vector in connection with a predetermined predicted frame is detected and the inter- 
na frame coding processing is carried out. 

In addition, in the transmitting unit two predicted frames are assigned to each of frame data F1. F2, F3 ... and a 

motion vector is detected about eadi predicted-frame _ 

Furthermore in the transmitting unit, predicted result frame data are produced from frame data of respective pre- 
dicted frame witii reference to two detected motion vectors, and then the resulting two kinds of predicted result frame 
45 data are interpolated to generate interpolative predicted result frame data. The Interframe coding is performed by select- 
ing frame data, of which difference data Is the smallest, from the predicted result frame data and interpolative predicted 
result frame data; that is, selective prediction processing Is carried out. Hereinafter, prediction in which frame data, 
Inputted before frame data to be coded, is used as a predPcted frame is called fonfvard prediction; prediction in which 
frame data, inputted after frame data to be coded, is used as a predicted frame Is called backward prediction; and 
50 prediction In which interpolative predicted result frame data are used is called Interpolative prediction. 

Thus, tiie transmitting unit selectively performs the interframe coding processing so that the transmission frame 
data become a minimum in the amount of data, and tiiereby video signals are transmitted with improved transmission 
efficiency. 

When the interframe coding processing is carried out in tiie transmitting unit, firstiy the fourth frame data F3, F9 of 
55 each group of frames are interframe coded with previous frame data FO. F6 and the next frame data F6. F12 set as 
predicted frames (hereinafter referred to as processing level 1). Subsequentiy, the remaining frame picture F1, F2, F4. 
F5 ... are interframe coded with previous frame data FO, F3 and the next frame data F3, F6 being set as predicted frames 
(hereinafter referred to as processing level 2). 
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The interframe coding processing is snnall in data amount to be transmitted as compared to the intraframe coding 
processing. Thus, the more frame data are interframe coded, the smaller the whole video signals to be transmitted 
become in data amount. 

However, when frame data to be interframe coded increase, frame data which are far away from predicted frames, 
5 referred to by the frame data, must be interframe coded. Thus, a motion vector must be detected between frame data 
which are far away from each other, with the result in complicated detection of the motion vector. Particularly, in the 
selective predicted processing, the transmitting unit becomes complicated since motion vectors to be detected increase. 

In the embodiment, frame data F3 are interframe coded with frame data FO and F6 set as predicted frames. Then, 
the frame data F3, FO and F6 are set as predicted frames, and frame data Fl , F2, F4, F5 . .. between them are interframe 
10 coded. With these procedures, motion vectors can be detected between relatively close frame data, so that it is possible 
to efficiently transmit video signals with a simple construction. 

Thus, in the interframe coding processing at the level 1, the transmitting unit sets the leading frame data FO of a 
group of frames and the leading frame data F6 of the subsequent group of frames as reference predicted frames for 
detecting motion vectors to performing fonward and backward predictions. 
15 More specifically, the transmitting unit detects the motion vector MV3P between the frame data FO and the fourth 
frame data F3 for the forward prediction and the motion vector MV3N between frame data F6 and F3 for the backward 
prediction (FIG. 1(B)). Then, the frame data FO and F6 of predicted frames are shifted by amount of the motion vector 
MV3P and MV3N to construct predicted result frame data FP and FN for fonward and backward prediction, respectively. 

Subsequently, the transmitting unit linearly interpolates predicted result frame data FP and FN to generate predicted 
20 result frame data FPN for interpolative prediction. 

After difference data AFP. AFN, AFPN which are the diference in data between frame data F3 and predicted result 
frame data FP. FN, FPN are obtained, the transmitting unit selects the smallest difference data among the difference 
data AFP, AFN and AFPN.and converts It to transmission frame data F3X together with motion vectors MV3P and MV3N 
(FIG. 1(D)). 

25 Thus, in the receiving unit, the original frame data FO and F6 are reconstructed from the transmission frame data 
FOX and F6X. and then the original frame data F3 can be reconstructed on the basis of the reconstructed frame date 
FO and F6 and the transmission frame data F3X. 

On the other hand, in the processing at the level 2, the transmitting unit sets the leading frame date FO and F6 are 
the fourth frame data F3 and F9 as predicted frames for the first and the second frame data F1 and F2, F7 and F8, ... 

30 and then fonward and backward prediction are performed. 

Thus, In the transmitting unit, motion vectors MV1 P and MV1 N; MV2P and MV2N are detected with reference to 
frame data FO and F3 (FIG. 1(C)). Then, predicted result frame data FP and FN are constructed with reference to the 
motion vectors MV1 P and MV1N; MV2P and MV2N, respectively, and interpolative predicted result frame data FPN are 
also constructed. 

35 After difference data AFR AFN and AFPN are obtained with reference to the predicted result frame data FP, FN and 
FPN, respectively, the smallest difference data among the difference data AFP. AFN and AFPN are selected and con- 
verted to transmission frame data F1 X and F2X together with the motion vectors MV1 P and MV1 N; MV2P and MV2N. 

Similarly, the fourth frame data F3 and the leading frame data F6 of the subsequent group of frames are set as 
predicted frames for the fifth and the sixth frame data F4 and F5; F10 and F1 1 ; ... . 

40 When motion vectors MV4P and MV4N; MV5P and MV5N are detected, the transmitting unit constructs predicted 
result frame data FP, FN and FPN with reference to motion vectors MV4P and MV4N; MV5P arxl MV5N and then frame 

data FPN to produce difference data AFR-AFN and AFPNrTlienrthe sntallest differerice data among th 

AFP, AFN and AFPN is selected and converted to transmission frame data F4X and F5X together with motion vectors 
MV4P and MV4N; MV5P and MV5N. 

45 Thus, the flame data are separated into units of 6 frames and are processed in a combination of the Intraframe 
coding processing and the interframe coding processing and then transmitted. Frame data FO, F6, ... which have been 
Intraframe coded and then sent are reconstructed ard then the remaining frame data are subsequently reconstructed. 
If an error Occurs, the error is thus prevented from being transmitted to the other group of frames, and hence when the 
invention is applied to compact discs or the like, high picture quality video signals can be transmitted at high efficiency. 

50 Moreover, when Inversely reproduced or random accessed, frame data can be positively reconstructed. Thus, deg- 
radation of the picture quality is effectively prevented and video signals can be highly efficiently transmitted. 

In this embodiment, transmission frame data F0X-F5X are reordered In each group of frames in the order of the 
intraframe coding processing and the interframe coding processing and then transmitted (FIG. 1(E)). When transmitted, 
identification data representing predicted frame data and transmission frame data intraframe coded are added to each 

55 of the picture data F0X-F5X. 

That is, frame data F1 and F2; F4 and F5 require frame data FO and F3: F3 and F6 which are predicted frames for 
encoding and decoding, respectively. 

For the frame data F3, the frame data FO and F6 which are predicted frames are needed for encoding and decoding. 
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When the frame data to be intraframe coded are represented by a character A and the frame data to be processed 
at the levels 1 and 2 characters B and C as shown in FIG. 2, the transmitting unit outputs transmission frame data DATA 
(FIG. 2(A)) in the order of reference frame data AO, B3, C1 . C2, C4, C5. A6. 89 ... . 

In this operation, the transmitting unit transmits a prediction index PINDEX, fonward prediction reference index PID 
5 (FIG. 2(B)), backward prediction reference index N ID (FIG. 2(C)) together with the transmission frame data; the prediction 
index PINDEX is for Identifying foPA/ard prediction, backward prediction or interpolative prediction and the fonA/ard pre- 
diction reference index PID and the backward prediction reference index NID represent predicted frames of the fonward 
prediction and backward prediction, respectively. With these Indexes the receiving unit decodes transmission frame data 
with ease. 

10 In practice, such transmission of prediction index PINDEX for identifying fonward prediction, backward prediction or 
Interpolative prediction, fbnvard prediction reference index PID and backward prediction reference index NID represent- 
ing predicted frame together with transmission frame data, not only facilitates decoding in the receiving unit but also 
enables decoding of the original data with ease even if transmission frame data are transmitted in a format different in 
length of group of frames, processed frames at levels 1 and 2. etc. from the format of this embodiment. 

15 More specifically, original frame data can be decoded by shifting frame data of the predicted frame, which Is identified 
by the fonA^ard prediction reference index PID and backward prediction reference index NID according to the prediction 
index PINDEX, in the amount of the motion vector thereof and then by adding the difference data transmitted. 

Thus, the operability of the whole video signal transmission system is enhanced since video signals which are 
encoded in a different format can be easily decoded. 

20 Moreover, format may be selectively changed In a video signal or in a single recording medium, and hence a high 
picture quality moving video signals can be easily transmitted. 

(2) Construction of the Embodiment 

25 (2-1 ) Structure of the Transmitting Unit 

In FIG. 3, numeral 1 Indicates a transmitting unit of the video signal transmission system to which is applied the 
video signal transmission method above described. The transmitting unit highly efficiently encodes and converts input 
video signals VDin to transmissiori frame data DATA and then records them on a compact disc. 
30 The transmission unit 1 provides an Input video signal VD|n to a picture data inputting unit 2, where a luminance 
signal and a chrominance signal which constitute the input video signal VDnvi Is converted to a digital signal and then 
the amount of data is reduced to 1/4. 

More specifically, the picture data inputting unit 2 provides the luminance signal which has been converted to the 
digital signal to one field dropping circuit (not shown) to delete one field, and then the remaining one field of the luminance 
35 signal is removed every other line. 

The picture data inputting unit 2 delete one field from each of the two chrominance signals which have been converted 
to digital signals and then selectively outputs every other line of the chrominance signals. 

The picture data inputting unit 2 converts the luminance signals thinned, and the chrominance signals, selectively 
outputted, to data of a predetermined transmission rate through a time axis conversion circuit. 
40 With these operation, the input video signal VDim is preliminarily processed through the picture data inputting unit 
2, so that picture data Dy which continuously contain sequential frame data described above are constructed. 

When a start pulse signal ST-is lnputtedrthe reordering circuit 4 separates pictur 

inputted in the order of frame data AO. CI , C2, 83, C4, C5, A6, C7 into groups of frames in six frames, and then the 

reordering circuit 4 reorders them in the order to be encoded; AO, A6, B3, Cl , C2, C4. C5, A12, 89, C7, ... and outputs 
45 them. 

The subsequent intraframe coding and interframe coding is simplified by reordering the frame data In the order to 
encode in such a manner. 

When an end pulse signal END rises, the reordering circuit 4 stops outputting of the frame data after the frame data, 

inputted Immediately before the rise of the end pulse signal, is reordered. 
50 The reordering circuit 4 outputs frame group index GOF, forward prediction reference index PID, backward prediction 

reference index NID and temporary index TR. The frame group index GOF raises Its signal level at the head of each 

group of frames, and the temporary index TR represents the order of the frame data in each group of frames. 

A motion vector detecting circuit 6 receives the reordered picture data Dvn and processes each frame data by 

separating it into predetermined macro unit blocks. 
55 In this processing, the motion vector detecting circuit 6 delays frame data AO, A6, ... which are to be Intraframe 

coded for a predetermined time and outputs them for every macro unit block thereof to a subtracting circuit 8 whereas 

with respect to frame data 83, CI . C2, C4 ... to be interframe coded, the motion vector detecting drcurt 6 detects motion 

vectors MVP and MVN for each macro unit block with reference to predetermined predicted frames. 
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Furthermore, in this processing, the motion vector detecting circuit 6 obtains the difference data between frame 
data to be interframe coded and corresponding predicted result frame data in an absolute value summing circuit to 
thereby obtain error data ER which is the sum of absolute value of the difference data. 

Thus, in this embodiment, quantized stepsize or the like is switched by using the error data ER. so that degradation 
5 in picture quality is effectively avoided and video signals are efficiently transmitted. 

In addition, the motion vector detecting circuit 6 delays the frame group index GOF, fbnward prediction reference 
irdex PID, backward prediction reference index NID and temporary index TR together with the reordered picture data 
DvN a rnotion vector detection processing time and then outputs them for each macro unit block to the succeeding 
processing circuit. 

10 The subtracting circuit 8 generates difference data by obtaining the difference in data between predicted data 
Dppti, outputted from an adaptive prediction circuit 10, and picture data Dvn outputs the difference data Dz to a 
discrete cosine conversion circuit 12. 

In the intraframe coding processing, the adaptive prediction circuit 1 0 outputs a mean value of picture data of each 
pixel as predicted data Dpp, for each macro unit block. 

15 On the other hand, in the interframe coding processing the adaptive prediction circuit 10 selects one of forward 
prediction, backward prediction and interpolative prediction by canying out a selective prediction processing, and then 
the adaptive prediction circuit 10 outputs selected predicted result frame data as predicted data Dppi for each macro 
unit block. 

This enables difference data Dz (which corresponds to the smallest amount of data among the difference data AFP. 
20 AFNP and AFN) to be obtained about frame data to be interframe coded whereas about frame data to be intraframe 
coded, difference data Dz from the means value can be obtained. 

The discrete cosine transformation circuit 12 converts difference data Dz for each macro unit block by means of the 
DCT (discrete cosine transform) technique. 

A multiplication circuit 14 performs a weighting processing of output data from the discrete cosine transformation 
25 circuit 12 according to control data outputted from a weighting control circuit 16. 

Sight of a human being does not recognize degradation in picture quality of a display picture of which brightness 
changes in a short period, for exanple, even if video signals are roughly quantized and transmitted. 

On the contrary, degradation of the picture quality is sharply recognized about a region where brightness gradually 
changes when video signals of that region roughly quantized are sent. 
30 Accordingly, video signals are roughly quantized about the region where brightness changes in a short period and 
the quantized stepsize IS reduced for the brightness gradually changing region. In this manner, deterioration of the picture 
quality is effectively avoided and video signals are efficiently transmitted. 

In this case, the quantized stepsize is enlarged for a high portion of the spatial frequency whereas the quantized 
stepsize is reduced for a low portion of the spatial frequency. 
35 Thus, in this embodiment, a component which is hard to be recognized by human being is equivalently enlarged in 
quantized stepsize by weighting processing coefficients of which data are outputted from the discrete cosine transfor- 
mation circuit 12 according to error data ER outputted from the motion vector detecting circuit 6, and thereby the deg- 
radation of picture quality is effectively avoided and video signals are efficiently transmitted. 

A requantizing circuit 1 8 requantizes output data of the multiplication circuit 1 4, in which event the quantized stepsize 
40 is switched according to control data outputted from the data amount control circuit 20. 

Sight of the human being recognizes a display picture having a clear outline or boundary of an object to be good in 
„_ Jhe picture quality,-and hence degradation in picture quality-is effectively avoided and video signals are effi 
mitted by reducing the quantized stepsize of the outline and the boundary of the object. 

Thus, in tiiis embodiment, the quantized stepsize is switched according to the amount of output data from tiie discrete 
45 cosine transformation circuit 12, the amount of input data from the buffer circuit 21 and error data ER, and thereby the 
output data of tiie discrete cosine transformation circuit 12 is requantized to reflect the quality of the picture. In tiiis 
manner, deterioration of picture quality is effectively avoided and each frame data are transmitted at a fixed amount 

An inverse requantizing circuit 22 receives output data of the requantizing circuit 1 8 and carries out inverse quantizing 
processing which is an inverse processing of tiie requantizing circuit 18 to thereby reconstruct the input data of the 
50 requantizing circuit 18. 

An inverse multiplication circuit 24 performs a multiplication operation on the output data of the inverse requantizing 
circuit 22 inversely to the multiplication circuit 14 to thereby reconstruct input data of the multiplication circuit 14. 

Inversely to the discrete cosine transformation circuit 12, an inverse discrete cosine transformation circuit 26 converts 
output data of tfie inverse multiplication circuit 24, so that the input data of discrete cosine transformation circuit 12 are 
55 reconstructed. 

A adding circuit 28 adds tiie predicted data Dpp|. outputted from the adaptive prediction drcuit 10, to the output 
data of the inverse discrete cosine transformation circuit 26 and tfien outputs tiie r^ulting data to tiie adaptive prediction 
circuit 10. 



7 



EP00071 3340A2 rhtt p://www. g etthepatent.(xtm/Lo g in.do g/ $cbrundid g e/Fetch/EP00071 3340A2.cpc?fromCache=1 part=maintoolbar=bottoml 



Pa g e 8 of 59 



EP 0 713 340 A2 

Thus, in the adaptive prediction circuit 10. frame data Dp which reconstructs the input data of the subtracting circuit 
8 can be obtained through the adding circuit 28. and thereby the frame data Dp are selectively inputted to set a predicted 
frame. Thus, a selective prediction result is obtained about frame data subsequently inputted to the subtracting circuit 8. 

Accordingly, the inputting of frame data reordered in the processing sequence enables a selective prediction result 
5 to be detected by sequentially inputting frame data Dp in a selective manner in the adaptive prediction circuit 10, and 
hence video signals can be transmitted with a simple construction. 

In a run-length Huffman encoding circuit 30. output data of the requantizing circuit 18 are subjected to Huffman 
coding processing which is a variable length coding processing and is then outputted to a transmission data composition 
circuit 32. 

10 Similarly, a run-length Huffman encoding circuit 34 performs huffman encoding on motion vectors MVN and MVP 
and then output them to the transmission data composition circuit 32. 

Synchronously with a frame pulse signal Spp the transmission data composition circuit 32 outputs output data of 
run-length Huffman encoding circuits 30 and 34, prediction index P INDEX, fonward prediction reference index PID back- 
ward prediction reference index NID and temporary index TR together with control information or the like information of 
15 the weighting control circuit 16 and the data amount control circuit 20 in a predetermined sequence. 

A reordering circuit 33 reorders output data of the transmission data composition circuit 32 in the encoding order 
for each group of frames and then outputs the data reordered to the buffer circuit 21 , through which transmission frame 
data DATA are outputted. 

Thus, transmission frame data DATA which are constructed by high efficiency coding of the input video signal VD|n 
20 are obtained, and the recording of the transmission frame data DATA on a compact disc together with a synchronizing 
signal or the like signal enables deterioration of picture quality to be avoided and provides high density recording of 
video signals. 

(2-2) Reordering Circuit 

25 

As illustrated in FIGS. 4 and 5. the reordering circuit 4 operates synchronously with the frame pulse signal Spp (FIG. 
5(A)) and reorders and outputs picture data Dy (FIG. 5(D)) in the order of the intraframe coding processing and the 
interframe coding processing, the picture data Dv being inputted after the start pulse signal ST rises (FIG. 5(B)) and 
before the end pulse signal END rises (FIG. 5(C)). 
30 More specifically, the reordering circuit 4 provides the start pulse signal ST to a clear terminal C of the counter circuit 
40, which increments its count value, through an OR circuit 42 and thereby generates count data COUNT (FIG. 5(F)) 
which increments its value synchronously with the frame pulse signal Spp 

When the count data COUNT reaches to a value of 5, the decoder circuit 44 activates the clear terminal C through 
OR circuits 46 and 42. 

35 Thus, the count data COUNT sequentially circularly changes within a range from 0 to 5 synchronously with the 
frame pulse signal Spp 

A delay circuit 48 delays the start pulse signal ST for five frame cycles and then outputs it to the clear terminal C of 
the counter circuit 40 through the OR circuits 46 and 42. 

Thus, when the start pulse signal ST rises, the clear terminal C of the counter circuit 40 continuously rises for two 
40 frame cycles with a delay of five frames cycles, so that count data COUNT having continuous zero values are obtained. 
When the end pulse signal END rises, the counter circuit 40 loads data D^ of a value 1 , and thereby the count data 

COUNT sequentLally_ changes from a valueJ to^a 

An OR circuit 50 receives the end pulse signal END and an output signal from the OR circuit 42 and provides an 
output signal to a flip-flop circuit (F/F) 52. 
45 In response to this output signal, the flip-flop circuit (F/F) 52 rises in signal level for the leading two frame cycles of 
the first group of frames and for the leading one frame cycle of each subsequent group of frames. In this embodiment, 
the output signal of the flip-flop circuit (F/F) 52 Is used as group of frame index GOF (FIG. 5(G)). 

According to the count data COUNT, read only memory circuits (ROM) 54^, 56 and 58 construct fonward prediction 
reference index PID. backward prediction reference index NID and temporary index TR (FIGS. 5(H), (I) and (J)), respec- 
50 tively. 

More specifically, the read only memory circuit 54 outputs a forward prediction reference index PID having a value 
0 when the count data COUNT has a value 1, 2 or 3, a fbnward prediction reference index PID with a value of 3 when 
the count data COUNT has a value 4 or 5, and stops to output fonA/ard prediction reference index PID when the count 
data COUNT has a value 0. 

55 The read only memory circuit 56 outputs a backward prediction reference index NID having a value 0 when the 
count data COUNT has a value 1 , 4 or 5, a backward prediction reference index NID with a value of 3 when the count 
data COUNT has a value 2 or 3, and stops to output backward prediction reference index NID when the count data 
COUNT has a value 0. 



8 



EP00071 3340A2 mtt p://www. q etthepatent.com/Lo q in.do q/ $cbrundid g e/Fetch/EPQ0071 3340A2.cpc?fronriCache=1 part=maintoolbar=bottom 1 



Pa g e 9 of 59 



EP0713 340 A2 

The read only memory circuit 58 outputs a temporary index TR having a value 0, 3, 1 , 2, 4, 5 when the count data 
COUNT has a value 0. 1 . 2, 3. 4. 5. respectively. 

Thus, in response to each of the frame data, there are provided fonward prediction reference index PID and backward 
prediction reference index NID, which are refen-ed to in the tntraframe coding processing and the interframe coding 
5 processing, and temporary index TR representing the order of the frame data in the group of frames. 

A counter circuit 60 controls the timing of writing to memory circuits 61-65 according to an output signal of the OR 
circuit 42 and thereby frame data are sequentially loaded in the memory circuits 61 and 65. 

More specifically, the memory circuit 61 is held in a writing mode during a period of time that the fourth frame data 
B3, B9, .. . of each group of frames are inputted whereas the memory circuit 62 is held in a writing mode while the second 
10 frame data Cl , C7 ... are inputted. 

Similarly, the memory circuits 63, 64 and 65 are held in a writing mode while the third, tiie fifth and the sixth frame 
data C2, 08 .... 04, 010 05, Oil ... are inputted, respectively 

The memory circuit 66 is placed in a writing mode at the timing of rising of the start pulse signal ST and hence 
stores the frame data AO immediately after the rising of the start pulse signal ST 
15 A selecting circuit 68 is actuated on the basis of a delayed start pulse signal DST outputted from the delay circuit 
48. When the delayed start pulse signal DST rises, tiie selecting circuit 68 outputs the frame data AO stored in the 
memory circuit 66 to an input terminal of the following selecting circuit 70 whereas when the delayed start pulse signal 
DST falls, the selecting circuit 68 directly outputs picture data Dv; inputted to the reordering circuit 4. to the selecting 
circuit 70. 

20 The selecting circuit 70 receives the frame data, outputted from the selecting circuit 68, and the frame data, stored 
in the memory circuits 61 to 65, and selectively and sequentially outputs them according to count data OOUNT, so that 
the frame data inputted to the reordering circuit 4 are reordered in the order to tiie intraframe coding processing and the 
interframe coding processing and are then outputted. 

25 (2-3) Motion Vector Detecting Circuit 

As illustrated in FIGS. 6 and 7, the motion vector detecting circuit 6 processes the picture data Dvn, outputted from 
the reordering circuit 4, with reference to thefonward prediction reference index PID. backward prediction reference index 
NID and temporary index TR (FIGS. 7(A), (B) and (0)). 
30 More specifically, in the motion vector detecting circuit 6, read only memory circuits 72 and 73 receive the fbnward 
prediction reference index PID and the backward prediction reference irtdex NID and generate switching control data 
SW1 and SW2 (FIGS. 7(D) and (E)) of which logic levels fall when the fonward prediction reference index PID and tiie 
backward prediction reference index NID have a value of 3. respectively. 

A read only memory circuit 74 receives the temporary index TR and generates intraframe coding processing control 
35 data P INTRA (FIG.(F)) of which logic level rises when the temporary index TR has a value of 0 (corresponding to frame 
data to be intraframe coded). 

Similarly, read only memory circuits 75, 76, 77, 78 and 79 generate interframe coding processing control data WB3, 
WC1, WC2, WC4 and WC5 of which logic levels rise when the temporary index TR has a value of 3. 1, 2, 4 and 5 
(corresponding to frame data 83, 01, 02, 04 and 05 to be interframe coded), respectively. 
40 A delay circuit 80 delays the interframe coding processing control data WC5 and generates switching control data 
BON (FIG. 7(G))of which logic level rises at a leading frame of each group of frames except the first group of frames. 

_ ^ _ An OR circuit .82 receives^ttie interframe coding processing control data-W05 and the infr^^ " 

conti-ol data PINTRA to generate a frame memory control data WAP (FIG. 7(H)). 

Thus, the motion vector detecting circuit 6 operates on the basis of these control data generated in the read only 
45 memory circuits 73-79, the delay circuit 80 and the OR circuit 82. 

A blocking circuit 84 receives the picture data Dv(in) (FIG* 7(J)), which are sequentially inputted synchronously witii 
the frame pulse signal Spp (FIG. 7(1)) to separate each frame data into predetermined macro unit blocks. 

As shown in FIG. 8, each frame data (FIG. 8(A)) is divided in 5 x 2 vertically and horizontally on a display screen 
to produce 10 groups of block units (FIG. 8(B)). 
50 Furthermore, each group of block units is divided in 3 x 1 1 vertically and horizontally to produce 33 groups of macro 
units (FIG. 8(0)). The transmission unit 1 sequentially processes frame data in a group of macro units. 

In one group of macro units, picture data of pixels in column of eight and row of eight are assigned to one block, 
and picture data of six blocks in total are assigned to each macro unit. 

Luminance signals Yi , Y2. Y3 and Y4 of 2 x 2 blocks are allocated to four blocks of the six blocks whereas chrominance 
55 signals Op and Ob which con-espond to the luminance signals Yi, Y2, Y3 and Y4 are allocated to the remaining two blocks. 
Thus, frame data which is divided into 15 x 22 macro unit blocks through the blocking circuit 84 is obtained. 
A delay circuit 85 outputs frame data, which are outputted from the blocking circuit 84, with a delay of five frame 
cycles necessary for the motion vector detection processing. 
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Thus, in the motion vector detecting circuit 6, picture data Dy (out) (^'Q- ^i^) divided in macro unit blocks and 
outputted synchronously with detection of motion vectors. 

A delay circuit 86 delays frame group index GOF (IN) (FIG. 7{L)) by five frame cycles and thereby outputs a frame 
group index GOF (OUT) (FIG. 7(M)) which coincides In timing with the picture data Dv(out) outputted from the motion 
5 vector detecting circuit 6. 

A backward prediction frame memory circuit 88. forward prediction frame memory circuit 89 and interframe memory 
circuit 90 store respective frame data which are referred to for detecting motion vectors. 

More specifically, the backward prediction frame memory circuit 88 is controlled to enter picture data into it when 
intraframe coding processing control data P INTRA rises, and thereby picture data D|sjv is obtained through the backward 
10 prediction frame memory circuit 88. In the picture data Of^y, frame data AO Is outputted for one frame cycle, then frame 
data A6 continues for subsequent 6 frame cycles, and frame data A12 continues for subsequent 6 frame cydes (FIG. 
7(N)). 

The forward prediction frame memory circuit 89 is controlled to enter frame data Into it. the frame data being outputted 
from the backward prediction frame memory circuit 88 when the frame memory control data WAP rises. 
15 By this operation, picture data Dpv Is obtained through the fonward prediction frame memory circuit 89. the picture 
data Dpv containing frame data AO continuing for first five frame cycles of six frame cycles, in which frame data AS is 
outputted from the backward prediction frame memory circuit 88, frame data A6 continuing for subsequent 6 frame 
cycles, and frame data A12 for subsequent 6 frame cycles (FIG. 7(0)). 

The Interframe memory circuit 90 is controlled to receive picture data Dvn when the Interframe coding processing 
20 control data WB3 rises. 

By this operation, picture data Djfyjj is obtained through the interframe memory circuit 90, the picture data O^^j 
having the fourth frame data B3, B9 and B15 each continuing for six frame cycles (FIG. 7(P)). 

Selection circuits 92 and 93 receive picture data Dnv and Duvij, Dpv and D\^j and switch their contacts according 
to switching control data SW1 and SW2, respectively 
25 By this operation, the selection circuits 92 and 93 outputs frame data AO. A6. B3 which are referred to for detecting 
motion vectors, to following variable reading memory circuits 94 and 95 by sequentially switching. 

More specifically, in detecting motion vectors MV3N and MV3P of frame data B3, frame data A6 and AO are outputted 
to variable reading memory circuits 94 and 95, respectively 

In the processing at the level 2. frame data B3 and AO are outputted to variable reading memory circuits 94 and 95 
30 when motion vectors MV1 N, MV1 P and MV2N, MV2P of frame data CI and 02 are detected, respectively; and frame 
data A6 and B3 are outputted to variable reading memory circuits 94 and 95 when motion vectors MV4N, MV4P and 
MV5N. MV5P of frame data 04 and 05 are detected, respectively 

When the motion vector of frame data 01 is detected within a range of pixels In 8 columns and 8 rows, for example, 
with reference to reference frame AO, to detect the motion vector of the frame data 02 it is necessary to detect It within 
35 a range of pixels In 1 6 columns and 1 6 rows with reference to the frame data AO. 

Similarly, to detect motion vectors of the frame data 04 and 05 with reference to frame data AS, It Is necessary to 
detect them within a range of pixels In 16 columns and 16 rows and pixels in 8 columns and 8 rows, respectively 

Thus, for the processing at the level 2 it is necessary to detect a moving vector within a maximum range of pixels 
In 16 columns and IS rows. 

40 On the other hand, to detect the motion vector of the frame data B3 with reference to frame data AO and A6, it is 
necessary to detect it within a range of pixels in 24 columns and 24 rows. 

- Thus, when frame data Is divided.in groups of predetermined frames, and when frame data In each_groupj)f _frames_ 

is Interframe coded and then transmitted, the motion vector detecting range becomes too large in the motion vector 
detecting circuit 6, and hence it is likely that the motion vector detecting circuit 6 becomes complicated. 
45 To avoid this, In this embodiment the motion vectors at the level 2 are firstly detected, and then the motion vector 
detecting range of the frame data B3 is set with reference to the result of the detection. Thus, the overall structure of 
the motion vector detecting circuit 6 Is simplified. 

More specifically, as shown in FIGS. 25 and 26. with respect to each frame data 01 . 02 from the frame data AO to 
the frame data B3, motion vectors Vi, V2, V3 are sequentially detected, and the sum + V2 + V3 of the motion vectors 
50 Vi, V2 and V3 is detected. 

Then, a motion vector detection range of the frame data B3 Is set with a position, shifted by the sum vector Vi + V2 
+ V3. placed centrally, and a motion vector MV3P Is detected within the motion vector detection range. 
In this manner, the motion vector MV3P can be detected within a small motion vector detection range. 
In this embodiment, the fonward prediction and backward prediction motion vectors are detected to detect the motion 
55 vectors at the level 2, and motion vectors MV1 P and MV1 N of the frame data 01 are detected. Thus, the motion vector 
MV3P can be detected within a small motion detection range by setting the motion vector detection range with the 
position, offset by the motion vectors MV1 P and MV1 N. placed centrally. 

A selection circuit 96 provides frame data 01 , 02. 04 and 05 which are to be processed at the level 2 to subtraction 
circuits KN0-KN255 and KPo-KP255- 
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On the other hand, in the processing at the level 1 , the selection drcuit 95 switches the contact to provide frame 
data B3, which Is once stored in the interfranne memory circuit 90, to the subtraction circuits KN0-KN255 and KP0-KP255 
through a blocking circuit 97. 

The blocking circuit 97 divides the frame data B3 into macro unit blocks and outputs them as in the blocking circuit 
5 84, and thereby the blocking circuit 97 provides frame data B3 for every macro unit block to the subtraction circuits KNq- 
KN255 and KPo-KP255- 

Thus, motion vectors are sequentially detected about frame data C1 , C2, C4 and C5, and then a motion vector is 
detected about the frame data B3. 

The selection circuits 92 and 93 switch their contacts according to the motion vector detection sequence and sequen- 
10 tially output frame data B3 and AO. B3 and AO, A6 and B3, A6 and B3 to variable reading memory circuits 94 and 95 at 
the timing of inputting of frame data C1 . C2, C4 and C5 to the motion vector detecting circuit 6. Then, frame data A6 
and AO are outputted during the subsequent one frame cycle. 

The subtraction circuits KNo-KN255 and KP0-KP255 each include 256 x 2 subtraction circuits connected in parallel 
and sequentially input picture data of the luminance signal which constitutes each macro unit block. 
15 The variable reading memory circuits 94 and 95 output frame data, which are inputted through the selection circuits 
92 and 93, in a parallel manner to the subtraction circuits KN0-KN255 and KP0-KP255 according to control data 
outputted from the vector generating circuit 98. 

When in the processing at the level 2, the first picture data of the first macro unit block is inputted to the subtraction 
circuits KN0-KN255 and KP0-KP255. the variable reading memory circuits 94 and 95 output picture data to the subtraction 
20 circuits KN0-KN255 and KP0-KP255. the picture data being within a range of pixels in 16 columns and 16 rows about the 
picture data (that is, picture data within the motion vector detecting range). 

Similarly, when the second picture data of the first macro unit block is inputted to the subti-action circuits KN0-KN255 
and KPo-KP255, variable reading memory circuits 94 and 95 outputs picture data, within a range of pixels in 16 columns 
and 16 rows about the second picture data from the frame data of the predictive frame, to the subtraction circuits KNq- 
25 KN255 and KPo-KP255- 

In the processing at the level 2, the variable reading memory circuits 94 and 95 sequentially output picture data 
witiiin the motion vector detecting range with respect to picture data inputted to the subtraction circuits KN0-KN255 and 

KPo-KP255- 

Thus, in the level 2 processing, difference data, which is given in displacement of the prediction vector in the motion 
30 vector detecting range, can be obtained for each picture data of frame data to detect tiie motion vector through tiie 
subtraction circuits KN0-KN255 and KPo-KP255. 

On the other hand. In the processing at tiie level 1 , the variable reading memory circuits 94 and 95 output picture 
data to the subtraction circuits KNo"KN255 and KP0-KP255, the picture data being within a range of pixels in 16 columns 
and 16 rows about picture data displaced a predetermined amount from the picture data, which has been inputted to 
35 the subtraction circuits KN0-KN255 and KP0-KP255 Nwitii reference to the results of tiie detection of frame data CI and 
C2. C4 end C5. 

Thus, in the processing at the level 1 , difference data, which are given in displacement of the predicted frame, can 
be obtained within the motion vector detecting range for each picture data of frame data B3 through the subtraction 
circuits KNo-KN255 and KP0-KP255, the motion vector detecting range being shifted a predetermined amount. 

40 Absolute value adding circuits 100 and 101 receive subtraction data of each subtraction circuits KN0-KN255 and 
KP0-KP255 and detect a sum of the absolute values of the subtraction data for each of the subtraction circuits KN0-KN255 

and KPo-KP255, and then absolute value-adding circuits 1 0O and 1 01 outputs the sum of the_absolute values for each 

macro unit block. 

Thus, in the level 2 processing, 256 (16x16) difference data is obtained for each macro unit block, tiie difference 
45 data being produced through absolute value adding circuits 1 00 and 101 when the predicted frames are subsequentiy 
displaced witiiin the motion vector detecting range atx)ut the macro unit block shifted a predetermined amount. 

On the other hand. In the processing at level 1, 256 difference data Is obtained for each macro unit blocK the 
difference data being produced witii reference to the macro unit block when tiie predicted frame is subsequentiy displaced 
within the motion vector detecting range shifted a predetermined amount. 
so The comparison circuits 1 02 and 1 03 receive 256 difference data outputted from tiie absolute value adding circuits 
100 and 101 and output difference data DooMand DoopOf the difference data to comparison circuits 105 and 106, the 
difference data Dqon and Dqop being produced when picture data of tiie predicted frame is vertically and horizontally 
displaced 0 pixel (that is. when the predicted frame is not moved). 

Moreover, the comparison circuits 102 and 103 detect and output minimum values among the remaining difference 
55 data as error data ER(ER|sj and ERp) as well as detect position information of tiie minimum difference data. 

Thus, the position information to displace the predicted frame so as to minimize the difference data can be detected 
through tiie comparison circuits 1 02 and 1 03. and thereby rm^on vector can be sequentially detected about each macro 
unit block. 
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The error data ER (ER|vi and ERp ) can be judged that the larger hs value is. the more largely the picture changes 
in each maao unit block. 

Thus, it is possible to judge according to the error data ER whether or not the region moved. 

The en'or data ER becomes larger in value at outlines and boundary portions. 
5 Thus, the nature of the picture can be reflected to the requantizing processing by switching the quantizing stepsize 
at the data amount control circuit 20 as a reference of error data ER, and thereby video signals can be transmitted with 
effectively avoided deterioration of picture quality 

It is considered that the higher the spatial frequency is, the larger the enor data ER becomes. 

Accordingly, video signals can be highly efficiently transmitted with effectively avoided deterioration of picture quality 
10 by weighting the result of transformation according to the error data ER in the multiplication circuit 1 4, the transformation 
result being outputted from the discrete cosine conversion circuit 12. 

Thus, the nature of the picture can be reflected to the requantizing processing by switching the quantizing stepsize 
of the requantizing circuit 18 on the basis of the en^or data ER and by controlling weighting processing of the multiplying 
circuit 14. and thereby video signals can be transmitted with effectively avoided deterioration of picture quality. 
15 It is possible to detect positional information to move predicted frames so as to minimize difference data with refer- 
ence to a minimum difference data, and hence motion vectors can be sequentially detected with respect to each macro 
unit block. 

The comparison circuits 105 an 106 provides outcomes of the comparison between the error data ER^, ERp and 
the difference data Dqon. Dqop respectively. 
20 During these operation, the comparison circuits 105 and 106 convert the error data ERn, ERp and the difference 
data Dqon. Dqop to an amount of error and difference per one pixel as represented by the following equations: 



25 
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30 and in a range where the amount of error and difference are small, 0 vector is preferentially selected as the motion vector. 
When in a range having a small amount of error and difference, difference data .EN and .EP (FIG. 1) are generated 
with reference to the motion vectors, detected in the comparison circuits 1 02 and 1 03. the amount of data of the difference 
data .EN and .EP does not become considerably small as compared to the case where difference data .EN and .EP are 
generated on the basis of 0 vector, and the total amount of data increases because of transmission of the motion vector 
35 as significant information. 

Thus, in this embodiment, video signals are as a whole efficiently transmitted by preferentially selecting 0 vector as 
motion vector in the comparison circuits 105 and 106. 

The comparison circuits 105 end 106 switch contacts of the selection circuits 107 and 108 by outputting switching 
signals to selectively output 0 vector data MVq, and the detected motion vectors outputted from the comparison circuits 
40 1 02 and 103 according to the precedence of FIG. 9, and thereby motion vectors MV1 N and MV1 P (FIGS. 7(Q) and (R)) 
can be obtained through the selection circuits 107 and 108. 

Motion vector memory circuits 110-113 and 114-117 enter motion vectors MV1 N and MV1 P in response to interframe 

. . coding processing control data . WC_1. WC2._WC^^^ - 

and MV1 P, MV2P, M V4P, MV5P for fonward prediction or backward prediction with respect to frame data CI , C2, C4, C5 
45 which are processed at the level 2. 

On the other hand, adding circuits 120-122 and 123-125 receive motion vectors MV1N, MV2N, MV4N, MV5N and 
MV1P, MV2P, MV4P, MV5P, which have stored in the motion vector memory circuits 110-113 and 114-117 and output 
the result of adding of the motion vectors MV1 N, MV1 P, MV2N, and MV2P and the result of adding^of the motion vectors 
MV4N. MV4P, MV5N and MV5P to halving circuits 127 and 128. respectively 
50 In this embodimerYt. firstly motion vectors at the level 2 are detected, and then with reference to the result of the 
detection motion vectors are detected within a maximum range in 16 columns and 16 rows by previously setting the 
motion vector detecting range of the frame data B3. Thus, the overall structure of the motion vector detecting circuit 6 
is simplified. 

To do so. the adding circuits 120-125 and halving circuits 127 and 128 obtain 1/2 of the results of the adding about 
55 motion vectors MV1 N-MV5P, and thereby predicted motion vectors MV3NY and MN3PY which are represented by the 
following equations are produced: 

MV3NY=1 ■ {(MV1N-MV1P) + (MV2N-MV2P)} (3) 
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MV3NP = ^ ' {(• MV4N + MV4P) + (■ MV5N + MVSP)} (4) 

then, the predicted motion vectors MV3NY and MV3PY are outputted to adding circuits 132 and 133 through selection 
circuits 130 and 131. 

5 The selection circuits 130 and 131 switch their contacts in response to switching control data BON and thereby 
selectively output data Dqn and Dqp having a value of 0 about frame data CI, C2, C4 and C5 to be processed in the 
level 2 and predictive motion vectors MV3NY and MV3PY about frame data B3 to be processed in the level 1 . 

On the other hand, adding circuits 132 and 133 add output data MV3NY, Dqim and MV3PY Dqp of the selection 
circuits 130 and 131 to control data Df^ outputted from the vector generating circuit 98. 

70 Therefore, the motion vector is detected in the motion vector detecting region about each macro unit block with 
reference to the frame data CI, C2, C4, C5, and the motion vector detecting region displaced by the predicted motion 
vector MV3NY and MV3PY with reference to the frame data B3. ^ 

Accordingly motion vectors between frame data AO and B3, B3 and A6, which are frames away from each other, 
can be positively detected within a small motion vector detection range, and motion vectors can be detected with a 

15 simple construction. 

The motion vector detection range of the fonward prediction motion vector MV3P is set by averaging the sum of the 
fonward prediction and backward prediction motion vectors of the frame data CI , C2, and the motion vector detection 
range of the fonA/ard prediction motion vector MV3N is set by averaging the sum of the fonvard prediction and backward 
prediction motion vectors of the frame data C4, C5. Thus, motion vectors can be positively detected. 
20 Adding circuits 135 and 136 add predicted motion vectors MV3NY and MN3PY to motion vectors outputted from 
selection circuits 107 and 108 at the level 1 processing, so that motion vectors MVSP and MV3N are obtained. Thus, 
motion vectors MV3N and MV3P between frame data far away from each other with a simple construction as a whole. 

A counter circuit 1 38 is conrtposed of quinary counter circuit which sequentially counts frame pulse signals Spp after 
it is cleared by interframe coding processing control data WC5, and the counter circuit 1 38 outputs motion vector selection 
25 data MVSEL (FIG. 7(S)) which sequentially circulates from value 0 to value 4. 

Selection circuits 139 and 140 sequentially switch their contacts in response to the motion vector selection data 
MVSEL and thereby selectively output motion vectors MV3N and MV3P, outputted from the adding circuits 1 35 and 1 36, 
and motion vectors M V1 N to M V5P stored in motion vector memory circuits 1 1 0 to 1 1 7. Thus, motion vectors M VN and 
MVP (FIGS, 7(T)) and (U)) can be sequentially obtained through the motion vector detecting circuit 6. 

30 

(2-4) Run-length-Huffman Encoding Circuit 

As shown in FIG. 27, the run-length-Huffman encoding circuit 34 provides fonward prediction motion vectors MV1P, 
M V4P of frame data CI , C4 and backward prediction motion vectors MV2N, MV5N of frame data C2. C5 (that is, motion 
35 vectors which are detected by using frame data AO, B3, A6 as reference frames and hereinafter referred to as single 
vector) to a selection circuit 150. 

An adding circuit 1 51 receives backward jDrediction motion vectors MV1 N, MV4N of frame data CI , C4 and fonward 
prediction motion vectors MV2P, MV5P of the frame data C2, C5 (that is, motion vectors of frame data which are two 
frames away from frame data AO, 83, A6 and hereinafter referred to as double vectors), and the adding circuit 151 adds 
40 a value of 1 to the motion vectors to output when values of the latter are positive whereas it subt'acts a value of -1 from 
the motion vectors to output when values of the latter are negative. 

A halving circuit 152 receives an output of the adding circuit 151, and the result of the halving from which a remainder 
is removed is outputted to-the selection circuit 150: 

That is, the adding circuit 1 51 and the halving circuit 1 52 convert the motion vectors MV1 N, MV4N, MV2P and MV5P 
45 to motion vectors per one frame and output them. 

On tiie other hand, an adding circuit 1 53 receives motion vectors MV3P and MV3N of frame data 83 (tiiat is, motion 
vectors of frame data which are three frames away from frame data AO, A6 and hereinafter refen-ed to as triple vectors), 
and the adding circuit 153 adds a value of 2 to tfie motion vectors to output when the values of the latter are positive 
whereas it subtracts a value of -2 from them to output when the values are negative. 
50 A 1/3 division circuit 154 receives an output from the adding circuit 153 and outputs the result of the 1/3 division, 
from which a remainder is removed, to tiie selection circuit 150. 

That is, the adding circuit 153 and the 1/3 division circuit 154 converts motion vectors MV3P and MV3N to motion 
vectors per one frame and outputs them. 

In this manner, tiie motion vectors which are inputted to the selection circuit 150 are set to values which are equal 
55 to probabilities of their appearance, and thereby each motion vector is optimized witii ease. 

More specifically, as shown in FIG. 28, in sequentially continuous frames FM, Fi, F2 and F3, motion vectors Vi, V2 
and V3 which refen^ed to the frame FM have relationship of the following equations when the frames FM, Fi, F2 and F3 
are strongly correlated: 
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V2 N 2V1 (5) 

V3-3VI (6) 

5 Accordingly, a motion vector Vx of frames which are x frames away from each other is generally represented by 

the following equation: 

Vx%xV, (7) 

10 This will be understood from that the probability Vx{a) of the motion vector Vx is expressed by multiplying an 

appearance probability <t)V1(a) of the motion vector Vi by x in the horizontal axis when the appearance probability is 
statistically expressed with the motion vector represented by a. 

Thus, when the motion vector Vx is divided by x with the remainder removed and is then expressed using the value 
a, it is understood that: the appearance probability 1/X<t>Vx(a) of the motion vector Vx is equal to the appearance prob- 
15 ability ^y^{a) of the motion vector Vx and the motion vector Vi can be optimized by using the same table. 

According to this principle, the run-length-Huffman encoding circuit 34 provides a selected output of the selection 
circuit 150 to a read only memory 156 and outputs a data DV1 stored in the read only memory 156 by using the selected 
output as an address. 

As illustrated in FIG. 30, the read only memory 156 is designed to output in response to input data variable length 
20 coded such that the length of codes becomes sequentially longer with an input data having a value of 0 placed centrally, 
and thereby motion vectors converted per one frame are coded in the optimized manner. 

That is, when value of motion vectors are statistically detected, a motion vector having a value of 0 has the highest 
appearance probability and the appearance probability becomes smaller as the values of motion vectors becomes larger. 

Thus, in this embodiment, coding has been carried out so that the motion vectors having a value of 0 have the 
25 shortest code table, and thereby amount of data which is necessary to send motion vectors is, as a while, reduced, so 
that motion video signals are efficiently transmitted. 

Moreover, the read only memory 156 outputs a code length data DL1 representing a code length of the output data 
DV1 together with the data DV1 . 

After a remainder output circuit 160 performs division of the adding circuit 153 by a value 3, the data of remainder 
30 is outputted to the a read only memory circuit 162. 

As shown in FIG. 31 , the read only memory circuit 162 outputs a remainder data DV2 having a value 0 with a code 
length 1 in response to an input data having a value 0 whereas the read only memory circuit 162 outputs remainder 
data DV2 having values 10 and 1 1 with code length 2 for input data of values 1 and 2. 

The input data of the read only memory circuit 162 are remainders to which triple vectors have been converted per 
35 one frame, the triple vectors having undergone adding-and-subtracting operation in the adding circuit 153. Thus, the' 
value 0 has the largest appearance probability, and the appearance probability becomes smaller as the value grows. 

Accordingly, in this embodiment, the amount of data necessary for sending motion vectors is reduced as a whole 
by outputting remainder data DV2 having the shortest code length, and thereby moving picture video signals are effi- 
ciently transmitted. 

40 The read only memory circuit 1 62 outputs a code length data DLL2, representing the code length of the remainder 
data DV2, synchronously with the remainder data DV2. 

A selection circuit 164 switches its contacts synchronously with the selection circuit 150 to select and output the 

least significant bit of the output data outputted from the addingxircuit -151.and remainder_c^^ 

That is, the selection circuit 164 stops the selective outputting with respect to a single vector. 
45 The selection circuit 164 outputs data of the least significant bit inputted in response to a double vector. Thus, the 
selection circuit 164 selectively outputs to a parallel -serial conversion circuit 166 a selected output having a value of 1 
when the double vector has an even value whereas it outputs a selected output of a value 0 to the parallel-serial con- 
version circuit 166 when the double vector has an odd value or a value 0. 

The selection circuit 164 outputs a remainder data DV2 in response to a triple vector. 
50 A selection circuit 168 receives input data DLLO having a value 0 and DLL1 having value 1 and code length data 
DLL2, and the selection circuit 168 outputs code length data DL2 representing a code length of selected output data DJ 
outputted from the selection circuit 1 64. 

An adding circuit 170 outputs the result of adding of the code length data DL1 and DL2 to the parallel-serial con- 
version circuit 166. 

55 As illustrated in FIG. 32, the parallel-serial conversion circuit 166 adds the output data DJ of the selection circuit 
1 64 and the addition data of the adding circuit 1 70 to the output data DV1 of the read only memory 1 56 and then converts 
the resulting data to a serial data. 
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mus. in response to the single vector, the output data DV1 . outputted from the read only memory 1 56, and the code 
length data DL1 of the output data DV1 are converted to serial data and then outputted through the parallel-serial con- 
version circuit 166. 

In response to the double vector which has an even value, a remainder bit bi having a value 0 Is added to the output 
5 data DV1 . outputted from the read only memory 156; an addition data, having a value 1 added to resultant data is then 
converted to serial data. 

When the double vector has an odd value or a value 0, the remainder bit bi of a value 1 1s added to the output data 
DV1 ; an addition data, having a value 1 added to the code length data DL1 , is further added; and the resultant data is 
then converted to serial data. 

10 In response to the triple vector which has a value of 0 or a value +(3n + 1) (n = 0, 1 , 2, ...), the remainder bit bi of 
a value 0 is added to the output data DV1 ; an addition data, having a value 1 added to the code length data DL1, is 
further added; and the resultant data is then converted to serial data. 

When the triple vector has a value ±(3n + 2) (n = 0, 1, 2, ...), the remainder bits bi and b2 having values 1 and 0, 
respectively, are added to the output data DV1 ; an addition data, having a value 2 added to the code length data DL1 , 

15 is further added: and the resultant data is then converted to serial data. When the triple vector has a value ±(3n + 3) (n 
= 0, 1 , 2, ...), the remainder bits bi and b2 having values 1 and 1 . respectively, are added to the output data DV1 ; an 
addition data, having a value 2 added to the code length data DL1, is further added; and the resultant data is then 
converted to serial data. 

Thus, on the side of the object to be transmitted it is possible to judge whether or not the data of the motion vector 
20 thus variable length coded is a single, a double or a triple vector with reference to fonvard prediction reference index 
PID, backward prediction reference index NID and temporary index TR, and the motion vector can be decoded on the 
basis of the result of the judgement. 

Thus, single, double and triple vectors can be variable coded with a preference to a vector having the highest appear- 
ance probability by using a kind of table stored in the read only memory 1 56, and thereby motion vectors can be optimized 
25 with a simple construction. 

The motion vectors can be transmitted by such coding processing with a detected accuracy maintained, and video 
signals can be efficiently sent with degradation in picture quality being effectively avoided. 

(2-5) Adaptive Prediction Circuit 

30 

As illustrated in FIG. 10, an adaptive prediction circuit 10 selectively predict frame data B3, CI, C2, 04, and C5 with 
reference to the fonward prediction reference index PID. backward prediction reference index NID and temporary index. 
TR. 

More specifically, in adaptive prediction circuit 1 0 read only memory circuits 1 42, 1 43 and 1 44 receive the temporary 
35 index TR as shown in FIG. 1 1 to generate intraframe coding processing control data PINTRA (FIG.1 1(A)), interframe 
coding processing control data WB3 and WC5, respectively. 

Read only memory circuits 146 and 147 receive fonvard prediction reference index PID and backward prediction 
reference index NID to generate switching control data SW3 and SW4 (FIG. 11(B) and (C)) of which logic levels fall 
when the values of forward prediction reference index PID and backward prediction reference index NID are 0. 
40 An OR circuit 148 receives intraframe coding processing control data PINTRA and interframe coding processing 
control data WC5 to produce frame memory control data WAP. 

Thus th^adaptive prediction cjrquit 1 0Js.designed to operate on the basis of control data generated in the read only 

rriemory circuits 142 to 147 and the OR circuit 148. 

A mean value memory circuit 1 50 receives picture data Dvm (FIG. 1 1 (E)), which is outputted from the motion vector 
45 detecting circuit 6 synchronously with the frame pulse signal Spp (FIG. 1 1 (D)). to obtain mean value of picture data of 
luminance signals and chrominance signals for each maao unit fcHock. and then the mean value data are outputted to 
the transmission data composition circuit 32 (FIG. 3) as direct current data DC. 

In addition, the mean value memory drcuit 1 50 outputs direct curent data DC of frame data AO, A6, ... as predicted 
data DpRi to the subtracting circuit 8 (FIG. 3) through selecting circuit 152 at the timing of inputting frame data AO, A6, 
50 ... to be intraframe processed to the subtracting circuit 8. 

Thus, difference data D^ from the mean value of the picture data D^ivi can be obtained about frame data AO. A6, ... 
through the subtracting circuit 8. and after subsequently data conripressed through the discrete cosine transformation 
circuit 12. the multiplication circuit 14. the requantizing circuit 18 and the run-length Huffman encoding circuit 30, the 
difference data D^ is outputted to the transmission data composition circuit 32. 
55 On the other hand, a backward prediction frame memory circuit 1 54, fbnward prediction frame memory circuit 155 
and interframe memory circuit 1 56 receive picture data Dp (FIG. 1 1 (F)), reconstructed in the adding circuit 28, and store 
frame data of predicted frame which serve as references of the backward and fonward prediction. 

That is, the backward prediction frame memory circuit 154 enters picture data Dp into it when intraframe coding 
processing control data PINTRA rises. 
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Thus, through the backward prediction frame memory circuit 154, there can be provided picture data D^^^vf (^'G- 
1 1(G)) in which after frame data SAO which is reconstructed for one frame cycle is outputted. frame data SA6 similarly 
reconstructed continues for subsequent 6 frame cycles, and then frame data SA12 reconstructed lasts for subsequent 
12 frame cycles. 

5 On the other hand, tiie fbnward prediction frame memory circuit 155 enters frame data which is outputted from the 
backward prediction frame memory circuit 154 when the frame memory control data WAP rises. 

Thus, through tiie forward prediction frame memory circuit 1 55, tiiere can be provided picture data D pvF (FIG. 11 (H)) 
in which the reconsti'ucted frame data SAO lasts for the first 5 frame cycles among 6 frame cycles, during which recon- 
structed frame data SA6 is outputted from the backward prediction frame memory circuit 154. The reconstructed frame 

70 data SA6 continues for subsequent 6 frame cycles, and then the frame data SA12 reconstructed lasts for suttsequent 
12 frame cycles. 

The interframe memory circuit 156 enters picture data Dp into it when interframe coding control data WB3 rises. 
In this manner, picture data Di^tf (FIG. 11(1)) is obtained tiirough the interframe menrary circuit 156, the picture 
data DiNTp having reconstructed fourth frame data SB3, SB9 and SB15 each lasting for 6 frame cycles. 
15 Selection circuits 1 58 and 1 59 receive picture data Df^^P ^mf ^pvf ^intf ^"^J switch their contacts according 
to switching control data SW4 and SW3, so that frame data SAO, SA6, SB3, ... which are referred to for fonward and 
backward prediction are sequentially outputted to following variable reading memorycircuils 160 and 161. 

That is, the selection circuits 158 and 159 output reconstructed frame data SA6 and SAO to the variable reading 
memory circuits 160 and 161 at the timing of inputting tiie fourth frame data B3 of the group of frames to the adaptive 
20 prediction circuit 10. 

Then, the selection circuits 158 and 159 output reconstructed frame data SB3 and SAO to the variable reading 
memory circuits 160 and 161 at the timing of inputting the second and the third frame data CI and C2 of the group of 
frames to the adaptive prediction circuit 1 0 whereas the selection circuits 1 58 and 1 59 output reconstructed frame data 
SAO and SB3 at the timing of inputting of tiie fourth and the fifth frame data C4 and C5. 
25 Variable reading memory circuits 1 60 and 1 61 shift inputted frame data by amount of motion vectors MVN and MVP 
detected in the motion vector detecting circuit 6 and then outputs them to a selection circuit 163. 

Thus, the backward prediction frame data FN and fonward prediction frame data FP (FIG. 1 ) can be obtained through 
the variable reading memory circuits 1 60 and 1 61 by displacing the reconstructed frame data by a distance of the motion 
vector MVN and MVP and by outputting them, respectively. 
30 On tiie other hand, an adding circuit 1 64 adds frame data outputted from the variable reading memory circuits 1 60 
and then outputs them to the selection circuit 163 through the halving circuit 165. 

Thus, interpolative predicted result frame data FNP (FIG. 1) which linearly interpolates backward predicted result 
frame data FN and fonward result frame data FP can be obtained through the halving circuit 165. 

Subtracting circuits 165, 166 and 167 subtract frame data, outputted from the variable reading memory 160, the 
35 variable reading memory 16rl and the halving circuit 1 65 from frame data which are picture data Dvn. respectively. 

Thus, tiie backward prediction difference data AFN, the fbnvard prediction difference data AFP and tiie interpolative 
prediction difference data AFNP (FIG. 1) can be obtained for each maao unit block tiirough subti*acting circuits 165, 
166 and 167, respectively. 

Absolute value adding circuits 1 68, 1 69 and 1 70 change difference data, outputted from the subtracting circuits 165, 
40 1 66 and 1 67, to absolute values, which are accumulated for each macro unit block and then outputted. 

The backward prediction difference data AFN, the forward prediction difference data AFP and tiie interpolative pre- 

diction-difference-data.AFNP_(FIG. 1) can be_detectedjn amou thrqugh^absolute value adding circuits 168, 

169 and 170, respectively ~~ ~~ 

A comparison circuit 1 71 receives the sum of absolute value of each of the difference data AFN, AFP and AFNP to 
45 detect a minimum value thereof. 

In addition, the comparison drcuit 171 outputs a control signal to the selection circuit 163, and thereby backward 
predicted result frame data FN, fonward predicted result frame data FP or interpolative predicted result frame data FNP 
of which difference data AFN, AFP or AFNP is a minimum in amount of data is selected and outputted to the selectihg 
circuit 152. 

50 Thus, in the intraframe coding processing, mean values of frame data AO and A6 are outputted as predicted data 
Dppi to the subtracting circuit 8 tiirough the selecting circuit 152 whereas in the intraframe coding processing, frame 
data FN, FP or FNR of which difference data AFN, AFP or AFNP is a minimum in the amount of data, is selected for 
each macro unit blod< as predicted data Dppi and is outputted to the subtracting circuit 8. 

Thus, the difference data between tiie selectively predicted, backward predicted result frame data FN. fonfvard 

55 predicted result frame data FP, interpolative predicted result frame data FNP and framedata B3, Cl , 02. ... to be encoded 
can be obtained, tiirough tiie subtracting circuit 8 The difference data is sequentially data compressed through dis- 
crete cosine ti^nsformation circuit 12. multiplication circuit 14. requantizing circuit 18 and run-lengtti Huffman encoding 
circuit 30 and is then outputted to tiie transmission data composition circuit 32. 
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A selection circuit 172 is controlled by a comparison circuit 171 to switch its contact, and thereby difference data 
AINTRA which is the smallest in the amount of data is selected from the difference data AFN, AFP and AFNP and 
outputted to a comparison circuit 1 74. 

A sut}tracting circuit 176 receives picture data Dvn and direct current data DC and outputs the difference between 
5 them to an absolute value adding circuit 1 77. 

Similarly with the absolute value adding circuits 1 68 to 1 70, an absolute value adding circuit 1 77 accumulates abso- 
lute values of Inputted data for each macro unit block and then outputs the accumulated sum AINTER to the comparison 
circuit 174. 

The comparison circuit 174 outputs a switching signal to each macro unit block on the basis of the result of com- 
10 parison between the accumulated sum AINTER and the difference data AINTRA. 

An OR circuit 1 78 receives the switching signal, outputted from the comparison circuit 1 74, and the Intraframe coding 
processing control data PINTRA to control the contacts of the selecting circuit 152 to switch. 

When in frame data B3, C1 . C2, 04 and 05 which are assigned to be interframe coded, there is a macro unit block 
which may be sent in a smaller amount of data as a whole by intraframe coding processing, the comparison circuit 174 
75 outputs a switching signal to the selecting circuit 1 52 through the OR circuit 1 78 according to the result of the comparison 
between the accumulated sum AINTER and the difference data AINTRA so that the intraframe coding processing Is 
selected for the macro unit block 

That is, the accumulated sum AINTER Is accumulated br each macro unit block after the difference data between 
the picture data Dvn ^^d the direct current data DO is changed to an absolute value and hence the accumulated sum 
20 AINTER represents an amount of data when frame data B3, 01. 02, 04 and 05 assigned to be interframe coded are 
intraframe coded. 

Thus, it is possible to judge by obtaining the result of comparison between the accumulated sum AINTER and the 
difference data AINTRA whether or not the intraframe coding processing of each macro unit block provides a smaller 
amount of data to be transmitted. Even frame data B3. 01 , 02, 04 and 05 which are assigned to be interframe coded 
25 may be sent in a smaller amount of data on basis of that result of comparison as a whole by intraframe coding processing 
macro unit blocks thereof. 

As shown in FIG. 12, the selecting circuit 152 selects and outputs direct cun-ent data DC when In frame data B3, 
01 , 02, C4 and 05 which are assigned to be Interframe coded, there is a macro unit block which may be sent in a smaller 
amount of data as a whole by intraframe coding processing. Thus, transmission frame picture data of the macro unit 
30 block which has been intraframe coded Is transmitted to a destination of transmission. 

In this operation, the comparison circuit 1 74 preferentially selects the Intraframe coding processing within a range 
where the amount of data of each of the accumulated sum AINTER and the difference data AINTRA Is small, and thereby 
error transmission can be effectively avoided and a high quality video signal can be transmitted. 

The transmission of video signals interframe coded has a problem In that error transmission cannot be avoided 
35 when a transmission error is generated In frame data which are referred to for the interframe coding processing. 

Accordingly, even frame data B3, 01 . 02, 04 and 05 which are assigned to be interframe coded are preferentially 
intraframe coded for transmission not only when a small amount of data as a whole Is transmitted by the intraframe 
coding processing as described but also when a small amount of data is provided both the intraframe coding processing 
and the interframe coding processing, thereby increase of amount of data and error transmission can be effectively 
40 avoided and a high quality video signal can be transmitted. 

A selection circuit 180 receives and selectively outputs the output data (which Is an identification data having one 
of value s 1 .^jand 3 representing the badwrard prediction, Jhejorward.predlction.or the Interpolative prediction. respec- 
tively) of the comparison circuit 171 and Identification index PINDEXq (which in this case is an identification data of a 
value 0) indicating a macro unit block intraframe coded according to the output signal of the OR circuit 1 78, and thereby 
45 identification data P INDEX representing the selectively predicted prediction result can be obtained through the selection 
circuit 180. 

(2-6) Transmission Data Composition Circuit 

50 Synchronously with the frame pulse signal Spp the transmission data composition circuit 32 outputs output data of 
the run-length Huffman encoding circuits 30 and 34, the prediction index P INDEX, the forward prediction reference index 
PID, the backward prediction reference index NID, temporary index TR, frame group index GOF, control information of 
weighting control circuit 16 and data amount control circuit 20 to the reordering circuit 33 in a predetermined format and 
thereby transmission frame data DATA is constructed. 

55 That is. as shown in FIGS. 13 and 14, the transmission data composition circuit 32 adds a macro unit header HM 
to picture data which is outputted in unit of a macro unit block from the run-length Huffman encoding circuit 30 (FIG. 
13(C)). 

With respect to the frame data intraframe coded, a predictive Index PI (which is produced with reference to the 
Identification data PINDEX) representing the intraframe coding processing, the backward prediction processing, the 
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forward prediction processing or the interpolative prediction processing is added to the macro unit header HM to follow 
a header TYPE for identifying each macro unit block (FIG. 14(A)). 

In addition, according to the control information of the data amount control circuit 20, data QUANT which represents 
quantized stepsize of each macro unit block is added and than motion vector data MVD-P and MVD-N which represent 
5 the fonward prediction motion vector and backward prediction motion vector, respectively, are added. 

With respect to luminance signals Yi. Y2. Y3. Y4 and chrominance signals Cr, Cb assigned to a macro unit block, 
additional data CBP representing whether those signals have or not data to be transmitted, is added. 

On the other hand, in the macro unit blocks of frame data to be interframe coded (FIG. 14(B)), the header TYPE for 
identifying each macro unit block is followed by the luminance signal detected in the adaptive prediction circuit 10. DC 
10 level data DCM-Y. DCM-U and DCM-V (DC) of the chrominance signal, and then data QUANT representing a quantized 
stepsize is added. 

Thus, each macro unit block can be decoded on the basis of the macro unit header HM by adding a macro unit 
header HM for each macro unit block. 

On the other hand, a group of block units (FIG. 13(B)) is constructed by placing macro unit blocks in 3 columns and 
15 1 1 rows, and as illustrated in FIG. 15, a group-of-block-unit header HGOB is added at the head of each group of block 
units. 

The group-of-block-unit header HGOB includes an identification header GBSC representing the start of each group 
of block units, followed by identification header GN for identifying the group of block units. 

Then, a frame of transmission frame data is constructed by assembling groups of block units in 5 columns and 2 
20 rows (FIG. 13(A)), and a picture header PH is added at the head of each transmission frame data. 

As shown in FIG. 16, in the picture header PH a start index PSC representing the head of each group of frame is 
added with reference to a frame group index GOF outputted from the motion vector detecting circuit 6, and subsequently 
a current index CI D representing the sequence of frame data in each group of frames is added with reference to the 
temporary index TR. 

25 Moreover, a mode index PM for identifying the intraframe coding processing, the interframe coding processing at 

the level 1 or the interframe coding processing at the level 2 is added, and then fonA^rd prediction reference index PID 

and backward prediction reference index NID are added. 

Thus, for each transmission frame data a mode index PM, identifying the intraframe coding processing, the interframe 

coding processing at the level 1 or the interframe coding processing at the level 2, is added as well as the forward 
30 prediction reference index PID representing frame data for forward prediction and backward prediction, and tiie backward 

prediction reference index NID. Thus, the transmission frame data are easily decoded with reference to fonA^rd prediction 

reference index PID, backward prediction reference index NID and mode index PM. 

In tills manner, the receiving unit not only decodes the ti'ansmission frame data witii ease but also easily decodes 

it even when it is transmitted in a format different in ttie length of group of frames, processed frames at levels 1 and 2, 
35 etc, from the format of this emtxxliment. Thus, the moving picture transmission system is as a whole enhanced in oper- 

ability, and high quality video signals can be transmitted with ease. 

(2-7) Structure of the Receiving Unit 

40 In FIG. 1 7. 200 generally designates a receiving unit, and reconstructed data DpB which are obtained by reproducing 
a compact disc are received by a receiving circuit 201 . 

The receiving circuit 201 detects the head of each group of frames with reference to tiie start index PSC and then 

- -outputs the result of-the detection together-with the picture data-DvpB- — ~ 

As shown in FIG. 18, a reordering circuit 203 is provided by tiiis operation with a picture data DypB (FIG. 18(A)) 
45 having continuous frame data PAO, PB3, PCI , PC2 ... sequentially intraframe coded or interframe coded. 

The reordering circuit 203 outputs transmission frame data PB3, PCI, PC2 ... interframe coded with a delay of 7 
frame cycles. Thus, the reordering drcuit 203 reorders frame data PAO, PBS, PC1 , PC2 ... in the sequence of the intra- 
frame coding processing and interframe coding processing performed in the transmitting unit 1 (that is, the same 
sequence as a sequence of decoding) and outputs them (FIG. 18(B)). 
50 A buffer circuit 204 stores tiie picture data Dvrbn outputted from the reordering circuit 203 and then outputs it to a 
subsequent separation circuit 206 at a predetermined transmission rate. 

The separation circuit 206 reconsfructs the frame group index GOF, tiie forward prediction reference index PID, the 
backward prediction reference index NID, the temporary index TR, tiie prediction index PINDEX, the data DC (DCM-Y, 
DCM-U, DCM-V), QUANT, tiie motion vector data MVD-P and MVD-N with reference to tiie picture header Pi, the group 
55 of block unit header HGOB and tiie macro unit header HM. and then the separation circuit 206 outputs them to prede- 
termined circuits. 

The separation circuit 206 outputs the picture header PI, groi4>-of-block-unit header HGOB and macro unit header 
HM to a control circuit 207 at this time, so that tiie control circuit 207 obtains reconst-ucted data, having continuous 
frame data for each group of frames, by controlling a compact disc drive reproducing system. 
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That is. in normal reproduction mode, data which are sequentially recorded on the compact disc are. as described 
in connection with FIG. 18. reproduced to obtain the picture data Dvpbn (FIG. 19(B)). 

In reverse reproduction mode, an optical pickup is moved in a direction reverse to a direction in the normal repro- 
duction mode while the compact disc being rotated in the same direction as in the normal reproduction. Thus, a picture 
5 data DvpBN. which arranges groups of frames in an order reverse to the order in the nornnal reproduction, is obtained 
(FIG. 19(A)). 

In recording, the first group of frames (PA0-PC5) is inputted to the receiving unit 200 and then the second group of 
frames (PA6-PC1 1 ) and the third group of frames (PA1 2-PC1 7) are continuously inputted whereas in the reverse repro- 
duction, the third group of frames (PA12-PC17) is inputted and is followed by the second group of frames (PA6-PC1 1) 
10 and the first group of frames (PA0-PC5). 

Since the reordering circuit 203 delays frame data interframe coded 7 frame cycles, the frame data PAS is delayed 
by 6 frame cycles from the frame data PA1 2, and then subsequent frame data (PB1 5-PC1 7) follow the frame data PA1 2. 
and subsequent frame data (PB9-PC1 1) follow the frame data PAO and frame data PA6 (FIG. 19(B)). 

Also in the reverse reproduction mode as in the normal reproduction mode, frame data are arranged through the 
15 reordering circuit 203 so that continuous frame data intraframe coded are continuously followed by frame data processed 
at the levels 1 and 2. and then by frame data intraframe coded. 

Thus, in this embodiment, the frame group index GOF, the fonward prediction reference index PID, the backward 
prediction reference index NID. the temporary index TR etc. are added to each of the frame data and transmitted, and 
hence transmission frame data can be easily decoded also in the reverse reproduction as in the normal reproduction 
20 by subsequently decoding them in the subsequent run-length Huffman inverse coding circuit 21 0. inverse requantization 
circuit 21 1, inverse multiplying circuit 212, disaete cosine inverse transformation circuit 213 and prediction circuit 214 
with reference to these indexes. 

The separation circuit 206 removes picture header PI, group-of -block-unit header HGOB and macro unit header 
HM from the picture data Dvpbn then outputs them to the run-length Huffman inverse coding circuit 210. 
25 The run-length Huffman inverse coding circuit 210 performs a processing inverse to the processing of run-length 
Huffman coding circuit 30 (FIG. 3). so that the inputted data of the run-length Huffman coding circuit 30 are reproduced 
in the receiving unit 200. 

An inverse requantization circuit 21 1 receives output data of the run-length Huffman inverse coding circuit 210 and 
data QUANT, representing the quantized stepsize added to each of the macro unit header HM. and performs inverse 
30 requantizing processing as in the inverse requantizing circuit 22 (FIG. 3) to thereby reproduce the input data of the 
requantizing circuit 18 in the receiving unit 200, the inverse requantizing processing performing inverse to the processing 
of the requantizing circuit 18. 

On the other hand, the inverse multiplying circuit 212 receives output data of the inverse requantization circuit 21 1 
and performs inverse multiplication operation inverse to the operation of the multiplying circuit 14 (FIG. 3) with reference 
35 to data added to the each macro unit header HM to thereby reconstruct input data of the multiplying circuit 14 in the 
receiving unit 200. 

The discrete cosine inverse transformation circuit 213 performs inverse transformation on output data of the inverse 

multiplying circuit 21 2, the inverse transformation being inverse to the transformation of the discrete cosine transformation 

circuit 12 (FIG. 3). Thus, input data of the discrete cosine transformation circuit 12 is reconstructed. 
40 The adding circuit 218 adds predicted data DpRi, outputted from the adaptive prediction circuit 21 4. to output data 

of the discrete cosine inverse transformation circuit 213 and outputs it to the adaptive prediction circuit 214. 
The run-length Huffman inverse coding circuit 220 decodes the fonward prediction motion vector MVP and.the back:: 

ward prediction nnotion vector MVN which have been variable length coded in the run-length Huffman coding circuit 34 

of the transmitting unit 1 and outputs them to the adaptive prediction circuit 214. 
45 The adaptive prediction circuit 21 4 reconstructs predicted data DpR|, outputted from the adaptive prediction circuit 

10 of the transmitting unit 1 , with reference to output data Djin of the adding circuit 218 and motion vectors MVP and 

MVN. etc. 

In this manner, the original frame data transmitted can be reconstructed, and hence video data Dv can be recon- 
structed, through the adaptive prediction circuit 214. 
50 That is. the adaptive prediction circuit 214 outputs a direct current level data DC to the adding circuit 218 as a 
prediction data Dp^i with respect to frame data AO. A6 intraframe coded. 

Thus, the frame data AO. A6 intraframe coded are reconstructed through the adding circuit 218. 

Similarly with the adaptive prediction circuit 10 of the transmitting unit, the adaptive prediction circuit 214 includes 
a fonward prediction frame memory circuit, backward prediction frame memory circuit and an interframe memory circuit 
55 and stores frame data AO, A6 reconstructed in the fonward frame memory circuit and the backward prediction frame 
memory circuit (FIGS. 18(C) and (D)) to generate a predicted data of the frame data B3. 

Thus, the frame data B3 interframe coded at the level 1 can be reconstructed through the adding drcuit 218. 
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Moreover, the adaptive prediction circuit 2 1 4 stores the frame data B3 reconstructed in the interframe memory circuit 
(FIG. 1 8(E)) to produce frame data DpRi of the frame data C1 . C2, C4 and C5, and thereby the frame data C1 . C2, C4 
and C5 interframe coded at the level 2 can be reconstructed through the adding circuit 218. 

In addition, the adaptive prediction circuit 214 rearranges and outputs reconstructed frame data AO. A6, B3, ... in 
5 the original order (FIG. 18(F)). 

The receiving unit 200 includes an interpolating circuit (not shown) and reconstructs the original input video signal 
VD||sj by a technique of interpolative operation with reference to frame data reconstructed. 

Thus, video signals which are highly efficiently coded and recorded on a compact disc are reconstructed. 



10 (2-8) Adaptive Prediction Circuit 



As shown in FIG. 20, the adaptive prediction circuit 214 constructs predicted data DpRi with reference to the fonward 
prediction reference index PID, the backward prediction reference index NID. the temporary index TR and the direct 
cun-ent level data DC which have been separated in the separation circuit 206. 

15 More specifically, the adaptive prediction circuit 21 4 provides the direct current level data DC to a selection circuit 
230 which switches its contact with reference to the decoded identification data PINDEX (identification data of a macro 
unit block which has undergone the backward prediction processing, the fonward prediction processing, the interpolative 
prediction processing and the interframe coding processing). The adaptive prediction circuit 21 4 outputs the direct current 
level data DC to the adding circuit 218 at the timing of inputting frame data of intraframe coded macro unit block to the 

20 adding circuit 218. 

That is, the direct current level data DC is subsequently outputted as the predicted data Dppn in unit of a macro unit 
block for each of intraframe coded frame data PAO. PA6, ... . 

In addition, with respect to the macro unit block which has been preferentially intraframe coded in spite of assignment 
of the interframe coding processing, the direct current level data DC is outputted to the adding circuit 218. 
25 Thus, with respect to intraframe coded frame data PAO, PA6, ... and macro unit blocks, on which the intraframe 
coding processing has been preferentially selected although the interframe coding processing has been assigned, the 
original data can be reconstructed by adding output data of the discrete cosine inverse transformation circuit 213 and 
the predicted data Dpp^i through adding circuit 218. 

The adaptive prediction circuit 214 provides the output data Dji^ thus reconstructed in the adding circuit 218 to a 
30 backward prediction frame memory circuit 232 and a fonward prediction frame memory circuit 234 and reconstructs 
predicted data Dppi of subsequent frame data. 

The backward prediction frame memory circuit 232 and the fonward prediction frame memory circuit 234 are switched 
to writing mode with reference to the intraframe coding processing control data P INTRA and the frame memory control 
data WAP, respectively, and thereby the leading frame data AO of the frame group in the reconstructed frame data is 
35 Stored in the fonvard prediction frame memory circuit 234 and the frame data A6 of the subsequent group of frames is 
stored in the backward prediction frame memory circuit 232 (FIGS. 18 (C) and (D)). 

The selection circuits 236 and 238 switch their contacts in response to switching signals SEI_3 and SEL4 produced 
with reference to intraframe coding processing control data PINTRA, respectively, and thereby output frame data, stored 
in the backward prediction frame memory circuit 232 and forward prediction frame memory circuit 234, as backward x 
40 prediction and k^rward prediction frame data to subsequent variable reading memory circuits 240 and 242, respectively. 
The variable reading memory circuits 240 and 242 receive motion vectors MVN and MVP for each macro unit block 
through the selection circuits 244 and 246 and shift backward prediction frame data and fonn/ard prediction frame data 

by.amount of motion vectors MVN aixJ MVP. respectively. 

Thus, the frame data of the results of the backward prediction and the fonward prediction can be obtained about 
45 frame data B3 and B9 to be interframe coded at the level 1 through the variable reading memory circuits 240 and 242. 
respectively, and the frame data obtained are outputted to tiie selection circuit 230. 

An adding circuit 248 adds frame data outputted from the variable reading memory circuits 240 and 242 and outputs 
the added frame data to the selection circuit 230 tinrough a halving circuit 250. 

Thus, in the selection circuit 230 the direct current level DC witii respect to intraframe coded macro unit blocks of 
50 frame data B3 and B9 is inputted to the first input terminal 0 while frame data of the results of tiie backward prediction, 
the interpolative prediction and tiie fonward prediction are inputted to the second input terminal 1 . the third input terminal 
2, and the fourth input terminal 3, respectively. 

Thus, with respect to the frame data of 83 and 89. assigned to the level 1 processing, predicted data Dppi can be 
reconstructed by selectively outputting the input data of the first to the fourth input terminals 0-3 on tiie basis of tiie 
55 identification data PINDEX in the selection circuit 230. 

Accordingly, frame data PB3, PB9. which are sent subsequently to the frame data PAO and PA6, is decoded by 
adding the predicted data Dpp|, outputted to tiie adding circuit 218, to the output data of tiie discrete cosine inverse 
transformation circuit 213. so that the original data can be reconstructed. 
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An interframe memory 252 receives output data Djit^j of the adding circuit 218 on the basis of the interframe coding 
processing control data WB3, and among the frame data reconstructed in the interframe memory 252, frame data B3 
and B9 processed at the level 1 are thereby stored. 

Thus, similarly with recording, frame data B3. which are predicted frames of the frame data CI , C2, C4 and C5 can 
5 be obtained through the interframe memory 252 during a period that the frame data CI , C2, C4 and C5 to be processed 
at the level 2 last (FIG- 18(E)). 

Thus, frame data B3 and AO are outputted to the variable reading memory circuits 240 and 242 through the selection 
circuits 236 and 238, and thereby frame data of the results of the backward prediction, the fonward prediction and the 
interpolative prediction can be obtained through the varialjle reading memories 240. 242 and the halving circuit 250, 
10 respectively 

Accordingly predicted data Dppn about frame data Cl and C2 can be reconstructed through the selection circuit 
230. and thereby the frame data CI and C2 can be reconstructed in the adding circuit 218. 

On the other hand, frame data A6 and B3 are outputted to the variable reading memory circuits 240 and 242 through 
the selection circuits 236 and 238 during a period of two frame cydes following the frame data C1 and C2, and frame 
15 data of the results of the backward prediction, the forward prediction and the interpolative prediction can be obtained 
through the variable reading memory circuits 240, 242 and halving circuit 250. 

Consequently predicted data Dppi about the frame data C4 and C5 can be reconstructed through the selection 
circuit 230, and thereby the frame data C4 and C5 can be reconstructed in the adding circuit 218. 

Thus, frame data subsequently reconstructed are outputted as added data Djin from the adding circuit 218. 
20 The output data of a delay circuit 262 is directly inputted to selection circuit 264 and Is also inputted to the selection 
circuit 264 through the delay circuit 266. 

Moreover, the selection circuits 260 and 264 switch their contacts according to switching signal SEL2 and output 
their selected outputs to a selection circuit 268. 

The selection circuit 268 receives frame data, outputted from the forward prediction frame memory circuit 234 and 
25 the interframe memory circuit 252, other than the selected outputs of the selection circuits 260 and 264 and switches 
its contact according to the switching signal SEL1 . 

The switching signal SEL1 and SEL2 are generated according to the current index CID, added to each frame data 
and transmitted, and thereby frame data decoded are rearranged in the original order to reconstruct video data Dy (FIG. 
18(F)). 

30 Thus, frame data are sequentially intraframe coded and interframe coded in the state divided into predetermined 
groups of frames and then are transmitted, so that video signals can be efficiently transmitted with effectively avoided 
degradation of picture quality. 

In this embodiment, the motion vectors MVN and MVP are outputted through the selection circuits 244 and 246, 
and thus, in reverse reproduction motion vectors MVN and MVP are switched and outputted to the variable reading 
35' memory circuits 240 and 242. 

In the reordering circuit 203, frame data interframe coded are delayed for 7 frame cycles, so that in reverse repro- 
duction, frame data PA6 is delayed 6 frame cycles relative to the frame data PA1 2 and is followed by frame data PB1 5- 
PC17, PAO, and PB9-PC11. 

TTius, at the timing of inputting the frame data PB15, PBS and PB3, which are the results of the level 1 processing. 
40 to the adding circuit 208, frame data A6 and AO are stored in the backward prediction frame memory circuit 232 and 
frame data A12, A6 and AO are stored in the forward prediction frame memory circuit 234 (FIG. 19(C) and (D)). 

That is. frame data are stored in the backward prediction frame memory circuit 232 and the forward predictio 

memory circuit 234 in such a manner as to exchange positions of frame data in the case of normal reproduction. 
Thus, in reverse reproduction, on the contrary to the normal reproduction, frame data of the results of the fooA/ard 
45 prediction and the backward prediction can be outputted from the variable reading memory circuits 240 and 242 by 
switching and outputting the motion vectors MVN and MVP to the variable reading memory 240 and 242, respectively 
Thus, in response to the switching of the motion vectors MVN and MVP, the switching operation of the selection 
circuit 230 is exchanged in the fonA^ard prediction and the backward prediction, and hereby the reverse reproduction 
can be carried out with a simple structure. 
50 More specifically, since in transmitting frame data, data indicating the order of the predicted frames of the forward 
prediction, the backward prediction and the order in the group of frames are added and sent, also in the reverse repro- 
duction the transmission frame data can be easily decoded as in the normal reproduction. 

At the timing of inputting of frame data CI, C2, C4 and C5 to be processed at the level 2, predicted frames are 
stored in the backward prediction frame memory circuit 232 and the fonward prediction frame memory circuit 234 in the 
55 exchanged state with frame data being stored in the interframe memory 252 (FIG. 1 9(E)). Also in this case, the reverse 
reproduction can be made with a simple structure by exchanging the switching operations of the motion vectors MVN 
and MVP and the selection circuit 230 in the fonward prediction and the backward prediction. 

Thus, the original video signals can be reproduced by the normal reproduction and the reverse reproduction. 
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(3) Operation of the Embodiment 

In the construction above, the input video signal VDnyi are converted to digital signals at the picture data inputting 
unit 2, the amount of data thereof is reduced to 1/4, and then the video signals are converted to video signals VD (FIG. 

5 1 (A)) having sequentially continuous frame data AO, C1 , C2, B3 

After frame data AO, C1 , C2, B3. ... are divided into groups of frames consisting of units of 6 frames in the reordering 
circuit 4, the video signals VD are reordered in order to be coded, AO, A6, B3. C1, C2, C4, C5, ... (that is, frame data 
AO, A6 to be Intraframe coded, frame data B3 to be interframe coded at the level 1 and frame data C1 , C2, C4, C5 to 
be interframe coded at the level 2). 
TO Moreover, the frame group index GOF, the f onward prediction reference index PID, the backward prediction reference 
index NID and the temporary index TR representing the order in the group of frames are generated in the reordering 

circuit 4 and are outputted synchronously with the frame data AO, A6, B3, C1 , C2. C4 

After reordered in order to be encoded, AO, A6, B3, C1, C2, C4, C5, C7 the frame data are outputted with the 
predetermined identification data GOF, PID, NID and TR added to them. Thus, the subsequent intraframe coding process- 
es ing and interframe coding processing can be simplified. 

The picture data Dvn reordered are outputted to the adaptive prediction circuit 1 0 at a predetermined time after they 
are divided into macro unit blocks in the blocking circuit 84 of the motion vector detecting circuit 6. 

Among the picture data Dvn reordered, frame data AO, A6 and A12 which are each of leading frame data to be 
intraframe coded are directly outputted to the subtracting circuit 8. 
20 The frame data AO, A6 and B3 are respectively stored in the fonward prediction frame memory circuit 89, the back- 
ward prediction frame memory circuit 88 and the interframe memory circuit 90 to serve as references for detecting the 
motion vectors of the backward prediction and the fbn^vard prediction. 

That is, the frame data AO and A3 which are stored in the fonward prediction frame memory circuit 89 and the 
interframe memory circuit 90 are outputted to the variable reading memory circuits 94 and 95, and with respect to picture 
25 data of the frame data C1 and C2 picture data within a predetermined motion vector detecting range are outputted to 
subtraction circuits KNq to KN255 and KPq to KP255 in a parallel manner at the time of inputting the frame data C1 and 
C2 to the subtraction circuits KNq to KN255 and KPq to KP255. 

The absolute results of the substraction of the subtraction circuits KNo to KN255 and KPq to KP255 are accumulated 
for each macro unit block in the absolute value summing circuits 100 and 1 01 , and thereby difference data are obtained 
30 when predicted frames are sequentially shifted within the motion vector detecting range about the each of the macro 
unit blocks of frame data CI and C2. 

Similarly the frame data B3 and A6 which are stored in the interframe memory circuit 90 and the backward prediction 
frame memory circuit 88 are outputted to the variable reading memory circuits 94 and 95, and with respect to picture 
data of the frame data C4 and C5 picture data within a predetermined motion vector detecting range are outputted to 
35 subtraction circuits KNq to KN255 and KP© to KP255 in a parallel manner at the time of inputting the frame data C4 and 
C5 to the subtraction circuits KNo to KN255 and KPq to KP255. 

Thus, difference data can be obtained through the absolute value summing circuits 100 and 101 when predicted 
frames are sequentially shifted within a motion vector detecting range about each of the macro unit blocks of frame data 
C4 and C5. 

40 The minimum values of the difference data of the frame data CI , C2, C4 and C5 are detected in the comparison 

circuits 102 and 103, and thereby respective motion vectors of the forward prediction and the backward prediction are 

- detected; — - - 

The result of preference comparison between difference data, obtained in a state of a predicted frame being not 

moved, and a minimum difference data, obtained through the comparison circuits 102 and 103 is olrtained in the com- 
45 parison circuits 1 05 and 1 06, and thereby 0 vector data MVq and detected motion vectors, outputted from the comparison 

circuits 102 and 103 are selectively outputted according to the preference of FIG. 9. Thus, motion vectors are selected 

so that video signals can be as a whole sent efficiently. 

The nation vectors about the frame data CI . C2, C4 and C5 are outputted through the selection circuits 139 and 

140 and are also provided to the adding circuits 120 to 125 and the halving circuit 128. Thus, the operation of the 
50 equations (3) and (4) is carried out, so that predicted motion vectors MV3PY and MV3NY of the frame data B3 are 

detected. 

Thus, with respect to the frame data B3, its motion vector are detected within the motion vector detecting range on 
the basis of the predicted motion vectors MV3PY and MV3NY 

That is, for the frame data B3, the frame data AO and A6, stored in the fonward prediction frame memory circuit 89 
55 and the backward prediction frame memory circuit 88, are outputted to the variable reading memories 94 and 95, and 
the picture data, which have shifted within the motion vector detecting range by the predicted motion vectors MV3PY 
and MV3NY relatively to the picture data of the frame data 83. are outputted from the variable reading memories 94 
and 95 to the subtraction circuits KN0-KN255 and KP0-KP255 in a parallel manner. 
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By this operation, difference data can be obtained on the basis of the predicted motion vectors IVIVSPY and MVSNfY 
through the absolute value summing circuits 100 and 101 , and the motion vectors of the frame data B3 are detected by 
adding the predicted motion vectors MV3PY and MV3NY to the selective outputs of the selection circuits 107 and 108 
in the adding circuits 135 and 136. 
5 The picture data Dvn 'S outputted to the adaptive prediction circuit 10, in which mean values of the picture data of 
the luminance signal and the chrominance signal are obtained for each macro unit block through the mean value memory 
circuit 150 and these mean values data are outputted as direct current data DC to the transmission data composition 
circuit 32 and selecting circuit 152. 

In addition, the picture data Dvn outputted to the adaptive prediction circuit 1 0 is selectively predicted with reference 
TO to frame data AO, A6 and B3 (frame data reconstructed in the adding circuit 28) stored In the forward prediction frame 
memory circuit 155, the backward prediction frame memory circuit 154 and the interframe memory circuit 156. 

That Is, to selectively predict about the frame data 83, the frame data AO and A6 stored in the fonward prediction 
frame memory circuit 155 and the backward prediction frame memory circuit 154 are outputted through the selection 
circuits 1 58, 1 59 to the variable reading memory 1 60 and 161 , where the frame data are shifted by amount of the motion 
15 vectors to construct frame data FN and FP as the results of the backward prediction and fonward prediction, respectively. 

On the other hand, the frame data B3 is outputted to the subtracting circuits 165, 166 and 167. where the results 
of the subtraction of the frame data from the frame data FN and FP and the frame data FNP as the result of the inter- 
polative prediction (outputted from the halving circuit 165) which is constructed by the frame data FN and FP. 

The results of the subtraction are converted to absolute values in the absolute value summing circuits 1 68. 1 69 and 
20 170 and are then accumulated for each macro unit block, so that the backward prediction difference data AFN. the 
fonward prediction difference data AFP and the interpolative prediction difference data AFNP (FIG. 1) are obtained 
through the absolute value summing circuits 168, 169 and 170, respectively. 

The minimum value of the difference data AFN, AFP and AFNP is detected in the comparison circuit 1 71 . 

Preferential comparison as shown in FIG. 12 is carried out between the minimum value and the difference data 
25 relative to the direct current data DC in the comparison circuit 174, so that the result of the prediction selection of the 
backward prediction, the fonward prediction, the interpolative prediction and the intraframe coding processing are 
detected for each macro unit block through the comparison circuit 1 74. 

On the other hand, in selective prediction of the frame data C 1, C2, frame data AO, 83 stored in the fonward prediction 
frame memory circuit 1 55 and the interframe memory circuit 1 56 are outputted to the variable reading memory 1 60 and 
30 161 where frame data FN and FP as the result of the backward prediction and the fonward prediction are constructed, 
respectively. 

Thus, with respect to the frame data CI and C2 difference data AFN of the backward prediction. AFP of the fonward 
prediction and AFNP of the interpolative prediction are obtained in the subtracting drcuits 165 to 166 as in the frame 
data 83, so that the results of the prediction selection of the backward prediction, the fbnward prediction, the interpolative 
35 prediction and the intraframe coding processing is outputted through the comparison circuit 1 74 for each macro unit block. 

On the other hand, in selective prediction about the frame data C4 and C5, frame data 83 and AO which are stored 
in the interframe memory circuit 1 56 and the backward prediction frame memory 1 54 are outputted to the variable reading 
memory 160 and 161. where they are shifted by amount of the motion vectors to produce frame data as the result of 
the prediction. 

40 Thus, the results of the prediction selection of the frame data C4 and C5 are detected for each macro unit block 

through the comparison circuit 174 similarly to the frame data 83, CI and C2. 
The frame.data FN, FP and-FNP. . which are the results o^-the ljackward predictionrthe fon^^ 

interpolative prediction, respectively, and the direct current level data DC are selectively outputted according to the 

results of the prediction selection through the selecting circuit 152, so that the predicted data Dppi constructed are 
45 outputted to the subtracting circuit 8. 

On the other hand, the results of the prediction selection are outputted as the prediction index PINDEX from the 

selection circuit 180 to the transmission data composition circuit 32. 

The predicted data DpRi is subtracted from the picture data Dvn the subtracting circuit 8 to thereby produce 

difference data Dz. 

50 The difference data D2 is converted for each macro unit block according to the DCT technique in the discrete cosine 
transformation circuit 12. 

The output data of the discrete cosine transformation circuit 1 2 are weighted according to the error data ER, outputted 
from the motion vector detecting circuit 6, in the multiplication circuit 1 4 and are then requantized in quantized stepsize 
according to the error data ER, the anrtount of the output data of the discrete cosine transformation circuit 12 and the 
55 amount of the input data of the buffer circuit 21 in the requantizing circuit 1 8. 

Thus, the requantization of the data in quantized stepsize according to the error data ER, the amount of the output 
data of the discrete cosine transformation circuit 12 and the amount of the input data of the buffer circuit 21 as well as 
the weighting processing thereof enables video signals to be sent at transmitted with high quality and each frame data 
to sent at predetermined amount of data. 
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The requantized picture data are variable length coded in the run-length Huffman coding circuit 30. and then in the 
transmission data composition circuit 32 variable length coded data of the motion vectors MVN and MVP, prediction 
index PINDEX, fonward prediction reference index PID, backward prediction reference index NID, temporary index TR, 
etc. are added to the picture data, which are then converted to transmission data DATA according to the predetermined 
5 format (FIGS. 1 3 to 1 6) and are recorded on a compact disc. 

Moreover, the requantized picture data is inversely converted to input data of the discrete cosine transformation 
circuit 12 through the inverse requantizing circuit 22, the inverse multiplication circuit 24 and the inverse discrete cosine 
transformation circuit 26 and is then added to the predicted data DpR|, outputted from the adaptive prediction circuit 1 0, 
in the adding circuit 28 to be converted to frame data Dp which reconstructs the input data of the subtracting circuit 8. 
10 Thus, the frame data Dp is stored in the fonward prediction frame memory circuit 1 55, the backward prediction frame 
memory circuit 1 54 and the interframe memory circuit 1 56 of the adaptive prediction circuit 1 0 and is used as the fonward 
prediction frame data and the backward prediction frame data. 

Thus, predicted data Dppi about frame data subsequently to be inputted to the subtracting circuit 8 is generated, 
and sequentially transmission frame data DATA is obtained. 
15 Among the picture data Dvn reordered, frame data AO, B3 and A6 are stored in the fonward prediction frame memory 
circuit 89. interframe memory circuit 90 and the backward prediction frame memory circuit 88. respectively, and thereby 
motion vectors MV3P, MV3N, BV1 P. MV1 N, MV2P, MV2N ... of frame data B3, C1 , C2 are detected through the selection 
circuits 139 and 140. 

The picture data Dvn 'S outputted to the adaptive prediction circuit 10, in which mean values of the picture data of 
20 the luminance signal and the chrominance signal are obtained for each macro unit block through the mean value memory 
circuit 150 and are outputted as direct cun-ent data DC to the transmission data composition circuit 32. 

In addition, the picture data Dvn inputted to the adaptive prediction circuit 1 0 is selectively predicted with reference 
to frame data AO, A6 and 83 (frame data reconstructed in the adding circuit 28), and thereby difference data AFN, AFP 
and AFNP of the backward prediction, the fonward prediction and the interpolative prediction (FIG. 1) can be obtained, 
25 respectively 

Among the difference data AFN, AFP and AFNP. the difference data having the smallest amount of data is selected, 
and thereby the result of selective prediction is detected for each macro unit block. 

The frame data FN, FP and FNP, which are the results of the backward prediction, the fonvard prediction and the 
interpolative prediction, respectively, are selectively outputted according to the results of the prediction selection, so that 
30 the predicted data Dp^i constructed are outputted to the subtracting circuit 8. 

On the other hand, the results of the prediction selection are outputted as the identification data PINDEX to the 
transmission data composition circuit 32. 

The predicted data Dppi is subtracted from the picture data Dvn subtracting circuit 8 to thereby produce 
difference data D^. 

35 The difference data Dz is converted for each macro unit block'according to the DCT technique in the discrete cosine 
transformation circuit 1 2. 

The output data of the discrete cosine conversion circuit 1 2 are weighted according to the error data ER, outputted 
from the motion vector detecting circuit 6. in the multiplication circuit 14 and are then requantized in quantized stepsize 
according to the error data ER, the amount of the output of the discrete cosine transformation circuit 1 2 and the amount 
40 of the input of the buffer circuit 21 in the requantizing circuit 18. 

Thus, the requantization of the data in quantized stepsize according to the error data ER, the amount of the output 

of the discrete cosine transformation circuit 1 2 and the amount of the in put of the buffer circ uit 2 1 as well as the weig htin g 

processing thereof enables video signals to be transmitted with high quality and each frame data to be sent at prede- 
termined amount of data. 

45 The requantized data are variable length encoded in the run-length Huffman encoding circuit 30 and then in the 
transmission data composition circuit 32, are then variable length encoded according to a predetermined format, and 
are thereafter recorded on a compact disc in a predetermined format. 

On the other hand, motion vectors detected in the motion vector detecting circuit 6 are outputted to the run-length- 
Huffman circuit 34, where motion vectors are converted to vectors for one frame and are processed by adaptive encoding, 

50 and then they are recorded on a compact disc together with remainder data, and data, representing kind of the motion 
vectors, (that is, which can be detected by the fonward prediction reference index PID, the backward prediction reference 
index NID and the temporary index TR). Moreover, the requantized picture data is inversely converted to input data of 
the discrete cosine transformation circuit 1 2 through the inverse requantizing circuit 22, the inverse multiplication circuit 
24 and the inverse discrete cosine transformation circuit 26 and is then added to the predicted data DpRi outputted from 

55 the adaptive prediction circuit 10. in the adding circuit 28 to be converted to frame data Dp which reconstructs the input 
data of the subtracting circuit 8. 

Thus, the frame data Dp is stored in the adaptive prediction circuit 10 and is used as the forward prediction frame 
data and the backward prediction frame data. 
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Thus, predicted daia DpR, aboui frame data subsequently to bs inputted to the subtracting Gircuit 8 is generated, 
and sequentially transmission frame data DATA is obtained. 

On the other hand, in the receiving circuit 200, reproduced data Dpg which is obtained by playing back the conpact 
disc is inputted to the receiving circuit 201 , where the head of each group of frames is detected- Then, the reproduced 
5 data DpB is outputted together with the results of the detection to the reordering circuit 203 where it is reordered to 
produce picture data Dvpbn having continuous frame data sequentially intraframe coded and interframe coded. PAO, 
PA6, PB3, PC1,PC2... . 

The frame data reordered is outputted through the buffer circuit 204 to the separation circuit 206. where the frame 
group index GOF, the fonward prediction reference index PID, the backward prediction reference index NID, etc. which 
10 have been added to the frame data and transmitted are reconstructed. 

The frame data which has been outputted from the separation circuit 206 is inverse converted through the run-length 
Huffman inverse coding circuit 210, the inverse requantization circuit 211, the inverse multiplication circuit 212 and the 
discrete cosine inverse transformation circuit 213, so that the input data of the discrete cosine transformation circuit 12 
is reconstructed. 

15 The output data of the discrete cosine inverse transformation circuit 213 is added to the predicted data Dpp], out- 
putted from the adaptive prediction circuit 214. in the adding circuit 218. and the resultant output data Dj\i^ is outputted 
to the adaptive prediction circuit 214. 

In the adaptive prediction circuit 214, about transmission frame data intraframe coded the transmitted direct current 
level data DC is outputted as the predicted data DpRi through the selection circuit 230, and the output data Djin which 
20 sequentially reconstruct frame data AO, A6 and A1 2 are thereby obtained through the adding circuit 218. 

The frame data AO and A6 among the output data Oj^^ of the adding circuit 21 8 are stored in the backward prediction 
frame memory circuit 232 and fbnward prediction frame memory circuit 234 for decoding subsequent frame data B3, CI , 
C2. C4 ... . 

More specifically, the frame data AO and A6 which are stored in the backward prediction frame memory circuit 232 
25 and fonvard prediction frame memory circuit 234 are outputted through the selection circuits 236 and 238 to the variable 
reading memories 240 and 242. 

Where the frame data AO and A6 are displaced by amount of the motion vectors MVN and MVP for each macro unit 
block and then outputted, so that frame data as the results of the backward prediction and the forward prediction are 
constructed about the frame data B3. 
30 The frame data outputted from the variable reading memories 240 and 242 are inputted to the adding circuit 248 
and the halving circuit 250 to thereby construct frame data as the results of the interpolative prediction. 

The frame data as the results of the backward prediction, the fbnward prediction and the interpolative prediction are 
outputted together with the direct current data DC to the selection circuit 230, from which they are selectively outputted 
according to the identification data P INDEX, so that predicted data DpBt is constructed at»out the predetermined frame 
35 B3. 

Thus, the predicted data Dpqt is outputted to the adding circuit 218 to thereby decode the frame data B3. 
The frame data B3 decoded is stored in the interframe memory circuit 252 and is used as frame data for decoding 
frame data Cl, C2. C4, ... together with the frame data A6 and AO stored in the backward prediction frame memory 
circuit 232 and the forward prediction frame memory circuit 234. 
40 That is, the frame data A6 and B3 stored in the fonward prediction frame memory circuit 234 and the interframe 
memory 252 are outputted to the variable reading memories 240 and 242 through the selection circuits 236 and 238, 
- so that frame data as the results of the backward prediction, the fonward prediction and the interpolative prediction are 

constructed about the frame data Cl"and C2. 

On the other hand, the frame data B3 and AO stored in the interframe memory circuit 252 and the backward prediction 
45 frame memory circuit 232 are outputted to the variable reading memories 240 and 242, where frame data as the results 
of the backward prediction, the fonward prediction and the interpolative prediction are constructed about the frame data 
C4 and C5. 

Thus, predicted data Dppi regarding frame data CI , C2. C4 ... are obtained through the selection circuit 230 and is 
outputted to the adding circuit 218 to decode the frame data CI , C2. C4 ... . 
50 The decoded frame data AO, A6, B3, CI, C2, C4 , ... are outputted after they are rean^anged in the original order 
through the delay circuits 262 and 266 and the selection circuit 260. 264 and 268, and thereby video signals highly 
efficiently coded and transmitted can be reconstructed. 

On the other hand, in the reverse reproduction mode, the forward prediction and the backward prediction motion 
vectors are switched and then inputted to the variable reading memories 240 and 242, and at the same time, the contact 
55 switching operation of the selection circuit 23 is performed in the fon^ard prediction and the backward prediction, so that 
as in the normal reproduction mode, predicted data Dpp) is obtained to reconstruct the original frame data. 

The frame data AO and A6 among the output data Oj^^ of the adding circuit 218 are used in the adaptive prediction 
circuit 21 4 for decoding suljsequent frame data B3, CI . C2, C4 .... and tiie decoded frame data AO. A6. B3, Cl . C2, C4. 
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... are arranged in the original order in the adaptive prediction circuit 214 and are then outputted. and thus moving picture 
video signals which have highly efficiently coded and sent can be reproduced. 

(4) Effects of the Embodiment 

5 

According to the construction above described, frame data are divided into groups of frames including 6 frame units, 
the leading frame data of each group of frames is intraframe coded, the frame data and frame data, intraframe coded, 
of the subsequent group of frames are set as predicted frames, and the fourth frame data of the group of frames is 
interframe coded and sent. Thus, video signals can be efficiently encoded by a simple construction with deterioration 
10 of picture quality effectively avoided and hence can be efficiently transmitted with high quality. 

The fourth frame data of the group of frames and frame data intraframe coded of each group of frames and the 
subsequent group of frames are set as predicted frames, and the remaining frame data are thereby interframe coded 
and sent Thus, degradation of picture quality can be effectively avoided and the remaining frame data can be more 
efficiently encoded. 

75 Data representing each predicted frames are added to frame data to be interframe coded and then transmitted, and 
thereby the data transmitted can be decoded with a simple construction. 

In the construction above described, double vectors MV1N. MV2P, MV4N, MV5P and triple vectors MV3N, MV3P 
are converted to vectors per one frame and are processed by variable length coding with preference to vectors having 
high probability of appearance. Thus, coding processing is performed with a common table and hence motion vectors 

20 can be optimized with a simple construction. 

(5) Other Embodiments 

(5-1) In the embodiment above, it Is illustrated that: frame data are divided into groups of frames including 6 frame 
25 units; the leading frame data thereof is intraframe coded; and the fourth frame data is interframe coded at the level 

1 while the second, the third, the fifth and the sixth frame data are interframe coded at the level 2. The present 

invention is not limited to such processing but the intraframe coding processing and the interframe coding processing 

at the level 1 and 2 are variously combined according to needs. 

As shown In FIG. 21 , for example, frame data are divided into groups of frames including 6 frame units, leading 
30 frame data AO, A6 are intraframe coded, the third and the fifth frame data B2 and B4 may be interframe coded at 

the level 1 , and the second, the fourth and the sixth frame data CI . C3. and C5 maybe interframe coded at the level 2. 
In this case, frame data AO and B2, AO and A6, B2 and 84, AO and A6, and B4 and A6 may be set as predicted 

frames for frame data CI. 82. C3, 84 and C5. respectively and may be predicted by the adaptive prediction circuit 

as illustrated in FIG. 22. 

35 More specifically, as shown in FIG. 23. picture data Dy (FIG. 23(A)) is constructed by reordering frame data AO. 

CI, 82, C3. ... in the processing order of AO, A6, 82. CI, 84. C3, C5. and simultaneously a fonward prediction 
reference index PID (FIG. 23(8)) and a backward prediction reference index NID (FIG. 23(C)) are constructed; 

Where the values of 0, 2 and 4 of the fonward prediction reference index PID and the backward prediction 
reference Index NID represent that frame data AO and A6 to be intraframe coded, frame data 82 and frame data 
40 84 are predicted frames, respectively. 

The picture data Dp reconstructed on the basis of the picture data Dv is provided to the backward prediction 

._frame memoryJM.and the interframe memory circuitA56, ard the output data of. the i — - - - — ^— 

is provided to the interframe memory circuit 302. 

The contacts of the selection circuit 300 are held on the side of the backward prediction frame memory 154. 
45 Thus, the backward prediction frame memory 154 and the forward prediction frame memory 1 55 are switched 
to writing mode at the time of inputting frame data AO and A6 to be intraframe coded, and then the interframe memory 
circuits 156 and 302 are switched to writing mode at the time of inputting the third and the fifth frame data 82 and 
84. In this manner, frame data AO. A6, 82, 84 can be stored in each of the frame memory circuit 154 to 156 and 
302 (FIGS. 23(D). (E). (F) and (G)). 
50 Thus, the contacts of selection circuits 304 and 305 are sequentially switched in response to switching signals 
SW8 and SW9 (FIGS. 23(H) and (I)) and their selected outputs are outputted to variable reading memory circuit 
1 60 and 1 61 . By this operation, frame data FN, FNP and FP as the results of predictions can be constructed sequen- 
tially about frame data to be interframe coded; 83, CI, 84, C3 

Also when the processing sequence of frame data is switched in such a manner, frame data can be easily 
55 decoded in a receiving unit by adding the fonward prediction reference index PID and the backward prediction ref- 
erence index NID which represent predicted frames of each frame data. 

Moreover, also when frame data are processed in the processing sequence thereof as shown in FIG. 1 , frame 
data may be sequentially processed with reference to the fbnward prediction reference index PID and the backward 
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prediction reference index NID. whereby selective prediction processing can be performed by using the adaptive 
prediction circuit as iliusUaied In FiG. 22. 

The motion vector detection circuit and the adaptive prediction circuit of the receiving unit may be built similarly 
as in FIG. 22, and operations thereof may be switched with reference to the fonward prediction reference index PID 
5 and the backward prediction reference index NID. In this fashion, the present invention can be applied to the case 
where frame data are transmitted in the processing sequence thereof as shown in FIG. 1 , and hence the range of 
application of the transmitting unit and the receiving unit can be enlarged. 

Furthermore, frame data Dp may be directly inputted to the forward prediction frame memory circuit 155 by 
switching the contact of the selection circuit 300, of which the operation may be switched on the basis of the forward 
10 prediction reference index PID and the backward prediction reference index NID. In this case, the selection circuit 
300 may be adjusted to a case where frame data are processed in the processing sequence as shown in FIG. 24. 

That is, the first frame data AO is intraframe coded and then transmitted, and the third frame data B2 is transmitted 
by setting the frame data AO as the predicted frame. 

Then, the fifth frame data 64 and the seventh frame data B6 are sent by setting the frame data B2 and 84, 
15 which precede them by two frames respectively, as predicted frames, and the frame data C1 , C3, ... interposed are 
sent by setting frame data AO and B2, B2 and B4 as predicted frames. 

Thus, predetermined predicted frame data are entered into the forward prediction frame memory circuit 1 54, 
the backward prediction frame memory circuit 1 54, and the interframe memory circuits 1 56 and 302 with reference 
to the fonward prediction reference index PID and the backward prediction reference index NID, with the contact of 
20 the selection circuit 300 being switched over, and thereby video signals of the transmission format can be adaptively 
predicted. 

(5-2) In the embodiment above described, video signals are previously compressed in amount of data to 1/4, and 
then the case in which the intraframe coding processing and the interframe coding processing are performed is 
illustrated. However, the amount of data compression is not limited to this but may be set to various values according 
25 to needs; for example, the intraframe coding processing and the interframe coding processing may be directly carried 
out with data compression being omitted. 

(5-3) Furthermore, in the embodiment atxjve, the case where video signals are recorded on a compact disc is 
described. The present invention is not limited to this but may be widely applied to a case where video signals are 
recorded on various recording media such as magnetic tape and a case where video signals are directly transmitted 

30 through a predetermined transmission channel. 

(5-4) In the embodiment above, it is illustrated that succeeding frame data are divided in 6 frames, and detected 
motion vectors of which frame are 2 or 3 frames away from each other are transmitted. The present invention is not 
limited to this feature but may be widely applied to a case where motion vectors between frames which are frames 
away from each other are transmitted. 

35 (5-5) Furthermore, in the embodiment above, the case where video signals are recorded on a compact disc is 
desaibed. The present invention is not limited to this but may be widely applied to a case where video signals are 
recorded on various recording media such as magnetic tape and a case where video signals are directly transmitted 
through a predetermined transmission channel. 

According to the present invention, digital video signals are divided into groups of predetermined frame units; 

40 digital video signals of each group of frames are intraframe coded and are interframe coded and transmitted with 
reference to the previous and next digital video signals intraframe coded. Thus, the present invention provides a 
video signal transmission system which enables video signals to be efficiently encoded and transmitted with dete- 
rioration of picture quality being effectively avoided and thereby makes it possiWe to hi ghjy efficiently tra^^ 
quality video signals. 

45 According to the present invention there is provided a video signal transmission system in which: digital video 

signals to be coded by interframe processing are divided into a group which is first intraframe coded an transmitted 
with reference to previous and next digital video signals interframe coded and another group which is processed 
with reference to the digital video signals first interframe coded, and transmitted whereby video signals are more 
efficiently coded and sent with degradation of picture quality being avoided with a simple construction. 

50 According to the present invention, there is provided a video signal transmission system in which identification 

data of the digital video signals, which are referred to for the interframe coding processing, are added to the digital 
video signals, which are coded by the interframe processing and transmitted, and the digital video signals with the 
identification data are then transmitted, whereby the digital video signals transmitted are decoded with a simple 
construction. 

55 According to the present invention, motion vectors between frames which are frames away from each other are 

converted to vectors per one frame, optimized and then sent. Thus, motion vectors can be optimized and transmitted 
with a simple construction. 

While there has been described in connection with the prefen'ed embodiments of the invention, it will be obvious 
to those skilled in the art that various changes and modification may be made therein without departing from the 
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invention, and it is aimed, therefore, to cover in the appended claims all such changes and modifications as fall 
within the true spirit of the invention. 

Claims 

5 

1 . An encoding method (1 ) for encoding a digital video signal (VD) including a plurality of pictures (FO.FI ,...), comprising 
the steps of: 

reordering (4) said plurality of pictures; 

encoding (6,10,12,14,18,30,34) said reordered plurality of pictures as Intra-frame coded pictures or inter- 
10 frame coded pictures respectively to produce coded data (DATA) ; and 

appending (32) temporal information (CID,TR) to each picture header (PH) of said coded data identifying an 
input order of said plurality of pictures. 

2. A method for decoding data (Dp^) produced by encoding a digital video signal (VD) including a plurality of pictures 
15 (FO.FI,...), comprising the st^s of: 

separating (206) temporal information (CID,TR) from each picture header (PH) of said coded data (Dps) 
identifying an input order of said plurality of pictures in an encoder; 

decoding (210-214) said coded data encoded as intra-frame coded pictures or inter-frame coded pictures to 
produce a plurality of decoded pictures; 
20 reordering (214) said plurality of decoded pictures according to said temporal information. 

3. An apparatus (1) for encoding a digital video signal (VD) including a plurality of pictures (F0,F1,...) comprising: 

means (4) for reordering said plurality of pictures; 

means (6,10,12,14,18.30.34) for encoding said reordered plurality of pictures as intra-frame coded pictures 
25 or inter-frame coded pictures respectively to produce coded data (DATA); and 

means (32) for appending temporal information (TR.CID) to each picture header (PH) of said coded data 
identifying an input order of said plurality of pictures. 

4. A apparatus for decoding coded data produced by encoding a digital video signal (VD) including a plurality of pictures 
30 (F0,F1,...) comprising: 

means (206) for separating temporal information (CID.TR) from each picture header (PH) of said coded data 
identifying the input order of said plurality of pictures into an encoder; 

means (210-214) for decoding said coded data encoded as intra frame coded pictures or inter-frame coded 
pictures to produce a plurality of decoded pictures; 
35 means (214) for reordering said plurality of decoded pictures according to said temporal information. 

5. A method or apparatus according to any one of the preceding claims wherein said frames are divided into groups 
of frames, each group including at least one intra-frame coded frame, the frames being reordered according to their 
respective method of encoding, such that the or the first intra-frame coded frame of a subsequent group precedes 

40 the inter-frame coded frames of the current group after reordering. 
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